2025-05-23 21:09:21,164 [ 463871 ] INFO : ClickHouse root is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse (runner:53, check_args_and_update_paths) 2025-05-23 21:09:21,164 [ 463871 ] INFO : Cases dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:79, check_args_and_update_paths) 2025-05-23 21:09:21,164 [ 463871 ] INFO : utils dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/utils (runner:90, check_args_and_update_paths) 2025-05-23 21:09:21,164 [ 463871 ] INFO : base_configs_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/programs/server, binary: /home/ubuntu/_work/_temp/test/build/clickhouse, cases_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:92, check_args_and_update_paths) clickhouse_integration_tests_volume Running pytest container as: 'docker run --rm --name clickhouse_integration_tests_dnzqhs --privileged --dns-search='.' --memory=30709035008 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=5dc43a6382f0 -e DOCKER_BASE_TAG=5ccda723c1fc -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=d862517635bf -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=1 --color=no --durations=0 --report-log=parallel2_1.jsonl --report-log-exclude-logs-on-passed-tests 'test_storage_iceberg/test.py::test_cluster_table_function[azure-1]' 'test_storage_iceberg/test.py::test_cluster_table_function[azure-2]' 'test_storage_iceberg/test.py::test_cluster_table_function[s3-1]' 'test_storage_iceberg/test.py::test_cluster_table_function[s3-2]' 'test_storage_iceberg/test.py::test_delete_files[azure-1]' 'test_storage_iceberg/test.py::test_delete_files[azure-2]' 'test_storage_iceberg/test.py::test_delete_files[local-1]' 'test_storage_iceberg/test.py::test_delete_files[local-2]' 'test_storage_iceberg/test.py::test_delete_files[s3-1]' 'test_storage_iceberg/test.py::test_delete_files[s3-2]' 'test_storage_iceberg/test.py::test_iceberg_snapshot_reads[azure-1]' 'test_storage_iceberg/test.py::test_iceberg_snapshot_reads[azure-2]' 'test_storage_iceberg/test.py::test_iceberg_snapshot_reads[local-1]' 'test_storage_iceberg/test.py::test_iceberg_snapshot_reads[local-2]' 'test_storage_iceberg/test.py::test_iceberg_snapshot_reads[s3-1]' 'test_storage_iceberg/test.py::test_iceberg_snapshot_reads[s3-2]' 'test_storage_iceberg/test.py::test_metadata_cache[azure]' 'test_storage_iceberg/test.py::test_metadata_cache[s3]' -vvv " altinityinfra/integration-tests-runner:ad96270260ff '. Start tests ============================= test session starts ============================== platform linux -- Python 3.10.12, pytest-7.4.4, pluggy-1.5.0 -- /usr/bin/python3 cachedir: .pytest_cache Test order randomisation NOT enabled. Enable with --random-order or --random-order-bucket= rootdir: /ClickHouse/tests/integration configfile: pytest.ini plugins: timeout-2.3.1, repeat-0.9.3, order-1.0.0, reportlog-0.4.0, xdist-3.5.0, random-order-1.1.1 timeout: 900.0s timeout method: signal timeout func_only: False created: 10/10 workers 10 workers [18 items] scheduling tests via LoadFileScheduling test_storage_iceberg/test.py::test_cluster_table_function[azure-1] [gw1] [ 5%] FAILED test_storage_iceberg/test.py::test_cluster_table_function[azure-1] test_storage_iceberg/test.py::test_cluster_table_function[azure-2] [gw1] [ 11%] FAILED test_storage_iceberg/test.py::test_cluster_table_function[azure-2] test_storage_iceberg/test.py::test_cluster_table_function[s3-1] [gw1] [ 16%] FAILED test_storage_iceberg/test.py::test_cluster_table_function[s3-1] test_storage_iceberg/test.py::test_cluster_table_function[s3-2] [gw1] [ 22%] FAILED test_storage_iceberg/test.py::test_cluster_table_function[s3-2] test_storage_iceberg/test.py::test_delete_files[azure-1] [gw1] [ 27%] FAILED test_storage_iceberg/test.py::test_delete_files[azure-1] test_storage_iceberg/test.py::test_delete_files[azure-2] [gw1] [ 33%] FAILED test_storage_iceberg/test.py::test_delete_files[azure-2] test_storage_iceberg/test.py::test_delete_files[local-1] [gw1] [ 38%] FAILED test_storage_iceberg/test.py::test_delete_files[local-1] test_storage_iceberg/test.py::test_delete_files[local-2] [gw1] [ 44%] FAILED test_storage_iceberg/test.py::test_delete_files[local-2] test_storage_iceberg/test.py::test_delete_files[s3-1] [gw1] [ 50%] FAILED test_storage_iceberg/test.py::test_delete_files[s3-1] test_storage_iceberg/test.py::test_delete_files[s3-2] [gw1] [ 55%] FAILED test_storage_iceberg/test.py::test_delete_files[s3-2] test_storage_iceberg/test.py::test_iceberg_snapshot_reads[azure-1] [gw1] [ 61%] FAILED test_storage_iceberg/test.py::test_iceberg_snapshot_reads[azure-1] test_storage_iceberg/test.py::test_iceberg_snapshot_reads[azure-2] [gw1] [ 66%] FAILED test_storage_iceberg/test.py::test_iceberg_snapshot_reads[azure-2] test_storage_iceberg/test.py::test_iceberg_snapshot_reads[local-1] [gw1] [ 72%] FAILED test_storage_iceberg/test.py::test_iceberg_snapshot_reads[local-1] test_storage_iceberg/test.py::test_iceberg_snapshot_reads[local-2] [gw1] [ 77%] FAILED test_storage_iceberg/test.py::test_iceberg_snapshot_reads[local-2] test_storage_iceberg/test.py::test_iceberg_snapshot_reads[s3-1] [gw1] [ 83%] FAILED test_storage_iceberg/test.py::test_iceberg_snapshot_reads[s3-1] test_storage_iceberg/test.py::test_iceberg_snapshot_reads[s3-2] [gw1] [ 88%] FAILED test_storage_iceberg/test.py::test_iceberg_snapshot_reads[s3-2] test_storage_iceberg/test.py::test_metadata_cache[azure] [gw1] [ 94%] FAILED test_storage_iceberg/test.py::test_metadata_cache[azure] test_storage_iceberg/test.py::test_metadata_cache[s3] [gw1] [100%] FAILED test_storage_iceberg/test.py::test_metadata_cache[s3] =================================== FAILURES =================================== _____________________ test_cluster_table_function[azure-1] _____________________ [gw1] linux -- Python 3.10.12 /usr/bin/python3 started_cluster = format_version = '1', storage_type = 'azure' @pytest.mark.parametrize("format_version", ["1", "2"]) @pytest.mark.parametrize("storage_type", ["s3", "azure"]) def test_cluster_table_function(started_cluster, format_version, storage_type): instance = started_cluster.instances["node1"] spark = started_cluster.spark_session TABLE_NAME = ( "test_iceberg_cluster_" + format_version + "_" + storage_type + "_" + get_uuid_str() ) def add_df(mode): write_iceberg_from_df( spark, generate_data(spark, 0, 100), TABLE_NAME, mode=mode, format_version=format_version, ) files = default_upload_directory( started_cluster, storage_type, f"/iceberg_data/default/{TABLE_NAME}/", f"/iceberg_data/default/{TABLE_NAME}/", ) logging.info(f"Adding another dataframe. result files: {files}") return files files = add_df(mode="overwrite") for i in range(1, len(started_cluster.instances)): files = add_df(mode="append") logging.info(f"Setup complete. files: {files}") assert len(files) == 5 + 4 * (len(started_cluster.instances) - 1) clusters = instance.query(f"SELECT * FROM system.clusters") logging.info(f"Clusters setup: {clusters}") # Regular Query only node1 table_function_expr = get_creation_expression( storage_type, TABLE_NAME, started_cluster, table_function=True ) select_regular = ( instance.query(f"SELECT * FROM {table_function_expr}").strip().split() ) def make_query_from_function( run_on_cluster=False, alt_syntax=False, remote=False, storage_type_as_arg=False, storage_type_in_named_collection=False, ): expr = get_creation_expression( storage_type, TABLE_NAME, started_cluster, table_function=True, run_on_cluster=run_on_cluster, storage_type_as_arg=storage_type_as_arg, storage_type_in_named_collection=storage_type_in_named_collection, ) query_id = str(uuid.uuid4()) settings = "SETTINGS object_storage_cluster='cluster_simple'" if alt_syntax else "" if remote: query = f"SELECT * FROM remote('node2', {expr}) {settings}" else: query = f"SELECT * FROM {expr} {settings}" responce = instance.query(query, query_id=query_id).strip().split() return responce, query_id # Cluster Query with node1 as coordinator select_cluster, query_id_cluster = make_query_from_function(run_on_cluster=True) # Cluster Query with node1 as coordinator with alternative syntax > select_cluster_alt_syntax, query_id_cluster_alt_syntax = make_query_from_function( run_on_cluster=True, alt_syntax=True) test_storage_iceberg/test.py:717: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ test_storage_iceberg/test.py:710: in make_query_from_function responce = instance.query(query, query_id=query_id).strip().split() helpers/cluster.py:3571: in query return self.client.query( helpers/client.py:39: in wrap return func(self, *args, **kwargs) helpers/client.py:79: in query ).get_answer() _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = def get_answer(self): self.process.wait(timeout=DEFAULT_QUERY_TIMEOUT) self.stdout_file.seek(0) self.stderr_file.seek(0) stdout = self.stdout_file.read().decode("utf-8", errors="replace") stderr = self.stderr_file.read().decode("utf-8", errors="replace") if ( self.timer is not None and not self.process_finished_before_timeout and not self.ignore_error ): logging.debug(f"Timed out. Last stdout:{stdout}, stderr:{stderr}") raise QueryTimeoutExceedException("Client timed out!") if ( self.process.returncode != 0 or self.remove_trash_from_stderr(stderr) ) and not self.ignore_error: > raise QueryRuntimeException( "Client failed! Return code: {}, stderr: {}".format( self.process.returncode, stderr ), self.process.returncode, stderr, ) E helpers.client.QueryRuntimeException: Client failed! Return code: 115, stderr: Received exception from server (version 25.3.3): E Code: 115. DB::Exception: Received from 172.16.1.9:9000. DB::Exception: Setting object_storage_cluster is neither a builtin setting nor started with the prefix 'custom_' registered for user-defined settings. Stack trace: E E 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000f4b58fb E 1. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x0000000009f80e6c E 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x0000000009f8082b E 3. DB::AccessControl::CustomSettingsPrefixes::checkSettingNameIsAllowed(std::basic_string_view>) const @ 0x000000001232e9f8 E 4. DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000012449944 E 5. DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges&, DB::SettingSource) const @ 0x0000000012449cc3 E 6. DB::Context::checkSettingsConstraintsWithLock(DB::SettingsChanges&, DB::SettingSource) @ 0x00000000130c30b4 E 7. DB::TCPHandler::processQuery(std::optional&) @ 0x0000000014cb4303 E 8. DB::TCPHandler::receivePacketsExpectQuery(std::optional&) @ 0x0000000014ca97f4 E 9. DB::TCPHandler::runImpl() @ 0x0000000014c9cdb9 E 10. DB::TCPHandler::run() @ 0x0000000014cbbaf9 E 11. Poco::Net::TCPServerConnection::start() @ 0x00000000183ecfc7 E 12. Poco::Net::TCPServerDispatcher::run() @ 0x00000000183ed419 E 13. Poco::PooledThread::run() @ 0x00000000183b975b E 14. Poco::ThreadImpl::runnableEntry(void*) @ 0x00000000183b7c3d E 15. ? @ 0x00007f28fa6ebac3 E 16. ? @ 0x00007f28fa77d850 E . (UNKNOWN_SETTING) E (query: SELECT * FROM E icebergAzureCluster('cluster_simple', azure, container = 'mycontainer', storage_account_url = 'http://azurite1:30050/devstoreaccount1', blob_path = '/iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/', format=Parquet) E SETTINGS object_storage_cluster='cluster_simple') helpers/client.py:248: QueryRuntimeException ---------------------------- Captured stdout setup ----------------------------- 25/05/23 21:09:29 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ---------------------------- Captured stderr setup ----------------------------- Picked up JAVA_TOOL_OPTIONS: -Djdk.attach.allowAttachSelf=true Picked up JAVA_TOOL_OPTIONS: -Djdk.attach.allowAttachSelf=true Setting default log level to "WARN". To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel). ------------------------------ Captured log setup ------------------------------ 2025-05-23 21:09:27 [ 671 ] DEBUG : Command:[docker ps | wc -l] (cluster.py:121, run_and_check) 2025-05-23 21:09:27 [ 671 ] DEBUG : Stdout:1 (cluster.py:145, run_and_check) 2025-05-23 21:09:27 [ 671 ] DEBUG : No running containers (conftest.py:95, cleanup_environment) 2025-05-23 21:09:27 [ 671 ] DEBUG : Pruning Docker networks (conftest.py:97, cleanup_environment) 2025-05-23 21:09:27 [ 671 ] DEBUG : Command:[docker network prune --force] (cluster.py:121, run_and_check) 2025-05-23 21:09:27 [ 671 ] DEBUG : Command:[sysctl net.ipv4.ip_local_port_range='55000 65535'] (cluster.py:121, run_and_check) 2025-05-23 21:09:27 [ 671 ] DEBUG : Stdout:net.ipv4.ip_local_port_range = 55000 65535 (cluster.py:145, run_and_check) 2025-05-23 21:09:27 [ 671 ] DEBUG : ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 (cluster.py:419, __init__) 2025-05-23 21:09:27 [ 671 ] DEBUG : ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse (cluster.py:419, __init__) 2025-05-23 21:09:27 [ 671 ] DEBUG : ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 (cluster.py:419, __init__) 2025-05-23 21:09:27 [ 671 ] DEBUG : ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true (cluster.py:419, __init__) 2025-05-23 21:09:27 [ 671 ] DEBUG : ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 (cluster.py:419, __init__) 2025-05-23 21:09:27 [ 671 ] DEBUG : ENV HOSTNAME 4cda02e99764 (cluster.py:419, __init__) 2025-05-23 21:09:27 [ 671 ] DEBUG : ENV SHLVL 0 (cluster.py:419, __init__) 2025-05-23 21:09:27 [ 671 ] DEBUG : ENV HOME /root (cluster.py:419, __init__) 2025-05-23 21:09:27 [ 671 ] DEBUG : ENV OLDPWD / (cluster.py:419, __init__) 2025-05-23 21:09:27 [ 671 ] DEBUG : ENV DOCKER_HELPER_TAG 5dc43a6382f0 (cluster.py:419, __init__) 2025-05-23 21:09:27 [ 671 ] DEBUG : ENV PYTHONUNBUFFERED 1 (cluster.py:419, __init__) 2025-05-23 21:09:27 [ 671 ] DEBUG : ENV DOCKER_PYTHON_BOTTLE_TAG d862517635bf (cluster.py:419, __init__) 2025-05-23 21:09:27 [ 671 ] DEBUG : ENV UBSAN_OPTIONS print_stacktrace=1 (cluster.py:419, __init__) 2025-05-23 21:09:27 [ 671 ] DEBUG : ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=1 --color=no --durations=0 --report-log=parallel2_1.jsonl --report-log-exclude-logs-on-passed-tests 'test_storage_iceberg/test.py::test_cluster_table_function[azure-1]' 'test_storage_iceberg/test.py::test_cluster_table_function[azure-2]' 'test_storage_iceberg/test.py::test_cluster_table_function[s3-1]' 'test_storage_iceberg/test.py::test_cluster_table_function[s3-2]' 'test_storage_iceberg/test.py::test_delete_files[azure-1]' 'test_storage_iceberg/test.py::test_delete_files[azure-2]' 'test_storage_iceberg/test.py::test_delete_files[local-1]' 'test_storage_iceberg/test.py::test_delete_files[local-2]' 'test_storage_iceberg/test.py::test_delete_files[s3-1]' 'test_storage_iceberg/test.py::test_delete_files[s3-2]' 'test_storage_iceberg/test.py::test_iceberg_snapshot_reads[azure-1]' 'test_storage_iceberg/test.py::test_iceberg_snapshot_reads[azure-2]' 'test_storage_iceberg/test.py::test_iceberg_snapshot_reads[local-1]' 'test_storage_iceberg/test.py::test_iceberg_snapshot_reads[local-2]' 'test_storage_iceberg/test.py::test_iceberg_snapshot_reads[s3-1]' 'test_storage_iceberg/test.py::test_iceberg_snapshot_reads[s3-2]' 'test_storage_iceberg/test.py::test_metadata_cache[azure]' 'test_storage_iceberg/test.py::test_metadata_cache[s3]' -vvv (cluster.py:419, __init__) 2025-05-23 21:09:27 [ 671 ] DEBUG : ENV COMPOSE_HTTP_TIMEOUT 600 (cluster.py:419, __init__) 2025-05-23 21:09:27 [ 671 ] DEBUG : ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 (cluster.py:419, __init__) 2025-05-23 21:09:27 [ 671 ] DEBUG : ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d (cluster.py:419, __init__) 2025-05-23 21:09:27 [ 671 ] DEBUG : ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse (cluster.py:419, __init__) 2025-05-23 21:09:27 [ 671 ] DEBUG : ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 (cluster.py:419, __init__) 2025-05-23 21:09:27 [ 671 ] DEBUG : ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin (cluster.py:419, __init__) 2025-05-23 21:09:27 [ 671 ] DEBUG : ENV DOCKER_KERBERIZED_HADOOP_TAG latest (cluster.py:419, __init__) 2025-05-23 21:09:27 [ 671 ] DEBUG : ENV DOCKER_CHANNEL stable (cluster.py:419, __init__) 2025-05-23 21:09:27 [ 671 ] DEBUG : ENV DOCKER_CLIENT_TIMEOUT 300 (cluster.py:419, __init__) 2025-05-23 21:09:27 [ 671 ] DEBUG : ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 (cluster.py:419, __init__) 2025-05-23 21:09:27 [ 671 ] DEBUG : ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 (cluster.py:419, __init__) 2025-05-23 21:09:27 [ 671 ] DEBUG : ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e (cluster.py:419, __init__) 2025-05-23 21:09:27 [ 671 ] DEBUG : ENV PWD /ClickHouse/tests/integration (cluster.py:419, __init__) 2025-05-23 21:09:27 [ 671 ] DEBUG : ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 (cluster.py:419, __init__) 2025-05-23 21:09:27 [ 671 ] DEBUG : ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config (cluster.py:419, __init__) 2025-05-23 21:09:27 [ 671 ] DEBUG : ENV TZ Etc/UTC (cluster.py:419, __init__) 2025-05-23 21:09:27 [ 671 ] DEBUG : ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java (cluster.py:419, __init__) 2025-05-23 21:09:27 [ 671 ] DEBUG : ENV DOCKER_BASE_TAG 5ccda723c1fc (cluster.py:419, __init__) 2025-05-23 21:09:27 [ 671 ] DEBUG : ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 (cluster.py:419, __init__) 2025-05-23 21:09:27 [ 671 ] DEBUG : ENV LC_CTYPE C.UTF-8 (cluster.py:419, __init__) 2025-05-23 21:09:27 [ 671 ] DEBUG : ENV INTEGRATION_TESTS_RUN_ID 1 (cluster.py:419, __init__) 2025-05-23 21:09:27 [ 671 ] DEBUG : ENV WORKER_FREE_PORTS 30050 30051 30052 30053 30054 30055 30056 30057 30058 30059 30060 30061 30062 30063 30064 30065 30066 30067 30068 30069 30070 30071 30072 30073 30074 30075 30076 30077 30078 30079 30080 30081 30082 30083 30084 30085 30086 30087 30088 30089 30090 30091 30092 30093 30094 30095 30096 30097 30098 30099 (cluster.py:419, __init__) 2025-05-23 21:09:27 [ 671 ] DEBUG : ENV PYTEST_XDIST_TESTRUNUID 895ea656d8a74378ac11c0be7aa3718c (cluster.py:419, __init__) 2025-05-23 21:09:27 [ 671 ] DEBUG : ENV PYTEST_XDIST_WORKER gw1 (cluster.py:419, __init__) 2025-05-23 21:09:27 [ 671 ] DEBUG : ENV PYTEST_XDIST_WORKER_COUNT 10 (cluster.py:419, __init__) 2025-05-23 21:09:27 [ 671 ] DEBUG : ENV PYTEST_CURRENT_TEST test_storage_iceberg/test.py::test_cluster_table_function[azure-1] (setup) (cluster.py:419, __init__) 2025-05-23 21:09:27 [ 671 ] DEBUG : CLUSTER INIT base_config_dir:/clickhouse-config (cluster.py:719, __init__) 2025-05-23 21:09:29 [ 671 ] DEBUG : GatewayClient.address is deprecated and will be removed in version 1.0. Use GatewayParameters instead. (java_gateway.py:163, deprecated) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: A 2fd8eb7b3b011407aa2bbab9377dec2254c5b5a067bf7a2fd337da88d2e9b8d9 (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: j i rj org.apache.spark.SparkConf e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: j i rj org.apache.spark.api.java.* e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: j i rj org.apache.spark.api.python.* e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: j i rj org.apache.spark.ml.python.* e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: j i rj org.apache.spark.mllib.api.python.* e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: j i rj org.apache.spark.resource.* e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: j i rj org.apache.spark.sql.* e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: j i rj org.apache.spark.sql.api.python.* e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: j i rj org.apache.spark.sql.hive.* e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: j i rj scala.Tuple2 e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: r u SparkConf rj e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.SparkConf (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: i org.apache.spark.SparkConf bTrue e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !yro0 (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: c o0 set sspark.app.name sspark_test e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !yro1 (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: c o0 set sspark.master slocal e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !yro2 (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: c o0 contains sspark.serializer.objectStreamReset e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !ybfalse (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: c o0 set sspark.serializer.objectStreamReset s100 e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !yro3 (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: c o0 contains sspark.rdd.compress e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !ybfalse (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: c o0 set sspark.rdd.compress sTrue e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !yro4 (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: c o0 contains sspark.master e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: c o0 contains sspark.app.name e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: c o0 contains sspark.master e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: c o0 get sspark.master e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !yslocal (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: c o0 contains sspark.app.name e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: c o0 get sspark.app.name e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !ysspark_test (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: c o0 contains sspark.home e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !ybfalse (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: c o0 getAll e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !yto5 (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: a e o5 e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !yi8 (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: a g o5 i0 e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !yro6 (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: c o6 _1 e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !ysspark.master (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: c o6 _2 e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !yslocal (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: a e o5 e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !yi8 (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: a g o5 i1 e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !yro7 (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: c o7 _1 e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !ysspark.app.name (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: c o7 _2 e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !ysspark_test (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: a e o5 e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !yi8 (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: a g o5 i2 e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !yro8 (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: c o8 _1 e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !ysspark.rdd.compress (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: c o8 _2 e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !ysTrue (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: a e o5 e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !yi8 (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: a g o5 i3 e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !yro9 (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: c o9 _1 e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !ysspark.serializer.objectStreamReset (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: c o9 _2 e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !ys100 (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: a e o5 e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !yi8 (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: a g o5 i4 e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !yro10 (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: c o10 _1 e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !ysspark.app.submitTime (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: c o10 _2 e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !ys1748034568941 (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: a e o5 e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !yi8 (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: a g o5 i5 e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !yro11 (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: c o11 _1 e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !ysspark.submit.pyFiles (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: c o11 _2 e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !ys (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: a e o5 e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !yi8 (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: a g o5 i6 e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !yro12 (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: c o12 _1 e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !ysspark.submit.deployMode (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: c o12 _2 e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !ysclient (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: a e o5 e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !yi8 (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: a g o5 i7 e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !yro13 (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: c o13 _1 e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !ysspark.ui.showConsoleProgress (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: c o13 _2 e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !ystrue (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: a e o5 e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !yi8 (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: r u JavaSparkContext rj e (clientserver.py:501, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.java.JavaSparkContext (clientserver.py:512, send_command) 2025-05-23 21:09:29 [ 671 ] DEBUG : Command to send: i org.apache.spark.api.java.JavaSparkContext ro0 e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: A 2fd8eb7b3b011407aa2bbab9377dec2254c5b5a067bf7a2fd337da88d2e9b8d9 (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: m d o1 e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: m d o2 e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: m d o3 e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: m d o4 e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: m d o6 e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: m d o5 e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !yro14 (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: c o14 sc e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !yro15 (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: c o15 conf e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !yro16 (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: r u PythonAccumulatorV2 rj e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonAccumulatorV2 (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: i org.apache.spark.api.python.PythonAccumulatorV2 s127.0.0.1 i56337 s2fd8eb7b3b011407aa2bbab9377dec2254c5b5a067bf7a2fd337da88d2e9b8d9 e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !yro17 (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: c o14 sc e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !yro18 (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: c o18 register ro17 e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils isEncryptionEnabled e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils isEncryptionEnabled ro14 e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !ybfalse (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils getPythonAuthSocketTimeout e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils getPythonAuthSocketTimeout ro14 e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !yL15 (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils getSparkBufferSize e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils getSparkBufferSize ro14 e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !yi65536 (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: r u org.apache.spark.SparkFiles rj e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.SparkFiles (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: r m org.apache.spark.SparkFiles getRootDirectory e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.SparkFiles getRootDirectory e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !ys/tmp/spark-d65df9db-163c-4131-b033-69c6f0e90935/userFiles-d753287d-6a20-43a0-8794-1ddcefa1fe90 (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: c o16 get sspark.submit.pyFiles s e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !ys (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: r u org.apache.spark.util rj e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: r u org.apache.spark.util.Utils rj e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.util.Utils (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: r m org.apache.spark.util.Utils getLocalDir e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: c o14 sc e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !yro19 (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: c o19 conf e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !yro20 (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.util.Utils getLocalDir ro20 e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !ys/tmp/spark-d65df9db-163c-4131-b033-69c6f0e90935 (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: r u org.apache.spark.util rj e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: r u org.apache.spark.util.Utils rj e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.util.Utils (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: r m org.apache.spark.util.Utils createTempDir e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.util.Utils createTempDir s/tmp/spark-d65df9db-163c-4131-b033-69c6f0e90935 spyspark e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !yro21 (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: c o21 getAbsolutePath e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !ys/tmp/spark-d65df9db-163c-4131-b033-69c6f0e90935/pyspark-b7e23ca4-9725-4c77-a652-9d7b0d9cd683 (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: c o16 get sspark.python.profile sfalse e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !ysfalse (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getDefaultSession e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getDefaultSession e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !yro22 (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: c o22 isDefined e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !ybfalse (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: c o14 sc e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !yro23 (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !yao24 (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: c o24 put sspark.app.name sspark_test e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !yn (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: c o24 put sspark.master slocal e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !yn (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: i org.apache.spark.sql.SparkSession ro23 ro24 e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !yro25 (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession setDefaultSession e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession setDefaultSession ro25 e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession setActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession setActiveSession ro25 e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: c o14 stop e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession clearDefaultSession e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession clearDefaultSession e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession clearActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession clearActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:09:30 [ 671 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1656, add_instance) 2025-05-23 21:09:30 [ 671 ] DEBUG : Cluster name: project_name:rootteststorageiceberg-gw1. Added instance name:node1 tag:5ccda723c1fc base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/.env', '--project-name', 'rootteststorageiceberg-gw1', '--file', '/ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:1942, add_instance) 2025-05-23 21:09:30 [ 671 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1656, add_instance) 2025-05-23 21:09:30 [ 671 ] DEBUG : Cluster name: project_name:rootteststorageiceberg-gw1. Added instance name:node2 tag:5ccda723c1fc base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/.env', '--project-name', 'rootteststorageiceberg-gw1', '--file', '/ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml', '--file', '/ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/node2/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:1942, add_instance) 2025-05-23 21:09:30 [ 671 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1656, add_instance) 2025-05-23 21:09:30 [ 671 ] DEBUG : Cluster name: project_name:rootteststorageiceberg-gw1. Added instance name:node3 tag:5ccda723c1fc base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/.env', '--project-name', 'rootteststorageiceberg-gw1', '--file', '/ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml', '--file', '/ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/node3/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:1942, add_instance) 2025-05-23 21:09:30 [ 671 ] INFO : Starting cluster... (test.py:96, started_cluster) 2025-05-23 21:09:30 [ 671 ] INFO : Running tests in /ClickHouse/tests/integration/test_storage_iceberg/test.py (cluster.py:2672, start) 2025-05-23 21:09:30 [ 671 ] DEBUG : Cluster start called. is_up=False (cluster.py:2679, start) 2025-05-23 21:09:30 [ 671 ] DEBUG : Docker networks for project rootteststorageiceberg-gw1 are NETWORK ID NAME DRIVER SCOPE (cluster.py:825, print_all_docker_pieces) 2025-05-23 21:09:30 [ 671 ] DEBUG : Docker containers for project rootteststorageiceberg-gw1 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:833, print_all_docker_pieces) 2025-05-23 21:09:30 [ 671 ] DEBUG : Docker volumes for project rootteststorageiceberg-gw1 are DRIVER VOLUME NAME (cluster.py:841, print_all_docker_pieces) 2025-05-23 21:09:30 [ 671 ] DEBUG : Cleanup called (cluster.py:846, cleanup) 2025-05-23 21:09:30 [ 671 ] DEBUG : Docker networks for project rootteststorageiceberg-gw1 are NETWORK ID NAME DRIVER SCOPE (cluster.py:825, print_all_docker_pieces) 2025-05-23 21:09:30 [ 671 ] DEBUG : Docker containers for project rootteststorageiceberg-gw1 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:833, print_all_docker_pieces) 2025-05-23 21:09:30 [ 671 ] DEBUG : Docker volumes for project rootteststorageiceberg-gw1 are DRIVER VOLUME NAME (cluster.py:841, print_all_docker_pieces) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command:[docker container list --all --filter name='^/rootteststorageiceberg-gw1-.*-1$' --format '{{.ID}}:{{.Names}}'] (cluster.py:121, run_and_check) 2025-05-23 21:09:30 [ 671 ] DEBUG : Unstopped containers: {} (cluster.py:860, cleanup) 2025-05-23 21:09:30 [ 671 ] DEBUG : No running containers for project: rootteststorageiceberg-gw1 (cluster.py:874, cleanup) 2025-05-23 21:09:30 [ 671 ] DEBUG : Trying to prune unused networks... (cluster.py:880, cleanup) 2025-05-23 21:09:30 [ 671 ] DEBUG : Trying to prune unused images... (cluster.py:896, cleanup) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command:[docker image prune -f] (cluster.py:121, run_and_check) 2025-05-23 21:09:30 [ 671 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:145, run_and_check) 2025-05-23 21:09:30 [ 671 ] DEBUG : Images pruned (cluster.py:899, cleanup) 2025-05-23 21:09:30 [ 671 ] DEBUG : Trying to prune unused volumes... (cluster.py:905, cleanup) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command:[docker volume ls | wc -l] (cluster.py:121, run_and_check) 2025-05-23 21:09:30 [ 671 ] DEBUG : Stdout:1 (cluster.py:145, run_and_check) 2025-05-23 21:09:30 [ 671 ] DEBUG : Volumes pruned: 1 (cluster.py:910, cleanup) 2025-05-23 21:09:30 [ 671 ] DEBUG : Setup directory for instance: node1 (cluster.py:2692, start) 2025-05-23 21:09:30 [ 671 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4536, create_dir) 2025-05-23 21:09:30 [ 671 ] DEBUG : Create directory for common tests configuration (cluster.py:4541, create_dir) 2025-05-23 21:09:30 [ 671 ] DEBUG : Copy common configuration from helpers (cluster.py:4561, create_dir) 2025-05-23 21:09:30 [ 671 ] DEBUG : Generate and write macros file (cluster.py:4613, create_dir) 2025-05-23 21:09:30 [ 671 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_storage_iceberg/configs/config.d/query_log.xml', '/ClickHouse/tests/integration/test_storage_iceberg/configs/config.d/cluster.xml', '/ClickHouse/tests/integration/test_storage_iceberg/configs/config.d/named_collections.xml', '/ClickHouse/tests/integration/test_storage_iceberg/configs/config.d/filesystem_caches.xml'] to /ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/node1/configs/config.d (cluster.py:4649, create_dir) 2025-05-23 21:09:30 [ 671 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/node1/database (cluster.py:4666, create_dir) 2025-05-23 21:09:30 [ 671 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/node1/logs (cluster.py:4677, create_dir) 2025-05-23 21:09:30 [ 671 ] DEBUG : Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" (cluster.py:4758, create_dir) 2025-05-23 21:09:30 [ 671 ] DEBUG : Setup directory for instance: node2 (cluster.py:2692, start) 2025-05-23 21:09:30 [ 671 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4536, create_dir) 2025-05-23 21:09:30 [ 671 ] DEBUG : Create directory for common tests configuration (cluster.py:4541, create_dir) 2025-05-23 21:09:30 [ 671 ] DEBUG : Copy common configuration from helpers (cluster.py:4561, create_dir) 2025-05-23 21:09:30 [ 671 ] DEBUG : Generate and write macros file (cluster.py:4613, create_dir) 2025-05-23 21:09:30 [ 671 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_storage_iceberg/configs/config.d/query_log.xml', '/ClickHouse/tests/integration/test_storage_iceberg/configs/config.d/cluster.xml', '/ClickHouse/tests/integration/test_storage_iceberg/configs/config.d/named_collections.xml', '/ClickHouse/tests/integration/test_storage_iceberg/configs/config.d/filesystem_caches.xml'] to /ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/node2/configs/config.d (cluster.py:4649, create_dir) 2025-05-23 21:09:30 [ 671 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/node2/database (cluster.py:4666, create_dir) 2025-05-23 21:09:30 [ 671 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/node2/logs (cluster.py:4677, create_dir) 2025-05-23 21:09:30 [ 671 ] DEBUG : Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" (cluster.py:4758, create_dir) 2025-05-23 21:09:30 [ 671 ] DEBUG : Setup directory for instance: node3 (cluster.py:2692, start) 2025-05-23 21:09:30 [ 671 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4536, create_dir) 2025-05-23 21:09:30 [ 671 ] DEBUG : Create directory for common tests configuration (cluster.py:4541, create_dir) 2025-05-23 21:09:30 [ 671 ] DEBUG : Copy common configuration from helpers (cluster.py:4561, create_dir) 2025-05-23 21:09:30 [ 671 ] DEBUG : Generate and write macros file (cluster.py:4613, create_dir) 2025-05-23 21:09:30 [ 671 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_storage_iceberg/configs/config.d/query_log.xml', '/ClickHouse/tests/integration/test_storage_iceberg/configs/config.d/cluster.xml', '/ClickHouse/tests/integration/test_storage_iceberg/configs/config.d/named_collections.xml', '/ClickHouse/tests/integration/test_storage_iceberg/configs/config.d/filesystem_caches.xml'] to /ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/node3/configs/config.d (cluster.py:4649, create_dir) 2025-05-23 21:09:30 [ 671 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/node3/database (cluster.py:4666, create_dir) 2025-05-23 21:09:30 [ 671 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/node3/logs (cluster.py:4677, create_dir) 2025-05-23 21:09:30 [ 671 ] DEBUG : Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" (cluster.py:4758, create_dir) 2025-05-23 21:09:30 [ 671 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/resolver', 'RESOLVER_LOGS_FS': 'bind', 'AZURITE_PORT': '30050', 'AZURITE_STORAGE_ACCOUNT_URL': 'http://azurite1:30050/devstoreaccount1', 'AZURITE_CONNECTION_STRING': 'DefaultEndpointsProtocol=http;AccountName=devstoreaccount1;AccountKey=Eby8vdM02xNOcqFlqUwJPLlmEtlCDXJ1OUzFT50uSRZ6IFsuFq2UVErCz4I6tq/K1SZFPTOtr/KBHBeksoGMGw==;BlobEndpoint=http://azurite1:30050/devstoreaccount1;'} stored in /ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/.env (cluster.py:96, _create_env_file) 2025-05-23 21:09:30 [ 671 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2025-05-23 21:09:30 [ 671 ] DEBUG : No config file found (config.py:28, find_config_file) 2025-05-23 21:09:30 [ 671 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2025-05-23 21:09:30 [ 671 ] DEBUG : No config file found (config.py:28, find_config_file) 2025-05-23 21:09:30 [ 671 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 826 (connectionpool.py:547, _make_request) 2025-05-23 21:09:30 [ 671 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/.env --project-name rootteststorageiceberg-gw1 --file /ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml --file /ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/node3/docker-compose.yml pull] (cluster.py:121, run_and_check) 2025-05-23 21:09:31 [ 671 ] DEBUG : Command to send: m d o24 e (clientserver.py:501, send_command) 2025-05-23 21:09:31 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:09:31 [ 671 ] DEBUG : Command to send: m d o9 e (clientserver.py:501, send_command) 2025-05-23 21:09:31 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:09:31 [ 671 ] DEBUG : Command to send: m d o10 e (clientserver.py:501, send_command) 2025-05-23 21:09:31 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:09:31 [ 671 ] DEBUG : Command to send: m d o11 e (clientserver.py:501, send_command) 2025-05-23 21:09:31 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:09:31 [ 671 ] DEBUG : Command to send: m d o12 e (clientserver.py:501, send_command) 2025-05-23 21:09:31 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:09:31 [ 671 ] DEBUG : Command to send: m d o13 e (clientserver.py:501, send_command) 2025-05-23 21:09:31 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:09:31 [ 671 ] DEBUG : Command to send: m d o15 e (clientserver.py:501, send_command) 2025-05-23 21:09:31 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:09:31 [ 671 ] DEBUG : Command to send: m d o18 e (clientserver.py:501, send_command) 2025-05-23 21:09:31 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:09:31 [ 671 ] DEBUG : Command to send: m d o19 e (clientserver.py:501, send_command) 2025-05-23 21:09:31 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:09:31 [ 671 ] DEBUG : Command to send: m d o20 e (clientserver.py:501, send_command) 2025-05-23 21:09:31 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:09:31 [ 671 ] DEBUG : Command to send: m d o21 e (clientserver.py:501, send_command) 2025-05-23 21:09:31 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:09:31 [ 671 ] DEBUG : Command to send: m d o22 e (clientserver.py:501, send_command) 2025-05-23 21:09:31 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:09:31 [ 671 ] DEBUG : Command to send: m d o23 e (clientserver.py:501, send_command) 2025-05-23 21:09:31 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:32 [ 671 ] DEBUG : Stderr: node3 Skipped - Image is already being pulled by node2 (cluster.py:147, run_and_check) 2025-05-23 21:10:32 [ 671 ] DEBUG : Stderr: node1 Skipped - Image is already being pulled by node2 (cluster.py:147, run_and_check) 2025-05-23 21:10:32 [ 671 ] DEBUG : Stderr: proxy2 Skipped - Image is already being pulled by proxy1 (cluster.py:147, run_and_check) 2025-05-23 21:10:32 [ 671 ] DEBUG : Stderr: resolver Pulling (cluster.py:147, run_and_check) 2025-05-23 21:10:32 [ 671 ] DEBUG : Stderr: proxy1 Pulling (cluster.py:147, run_and_check) 2025-05-23 21:10:32 [ 671 ] DEBUG : Stderr: node2 Pulling (cluster.py:147, run_and_check) 2025-05-23 21:10:32 [ 671 ] DEBUG : Stderr: minio1 Pulling (cluster.py:147, run_and_check) 2025-05-23 21:10:32 [ 671 ] DEBUG : Stderr: azurite1 Pulling (cluster.py:147, run_and_check) 2025-05-23 21:10:32 [ 671 ] DEBUG : Stderr: minio1 Pulled (cluster.py:147, run_and_check) 2025-05-23 21:10:32 [ 671 ] DEBUG : Stderr: resolver Pulled (cluster.py:147, run_and_check) 2025-05-23 21:10:32 [ 671 ] DEBUG : Stderr: proxy1 Pulled (cluster.py:147, run_and_check) 2025-05-23 21:10:32 [ 671 ] DEBUG : Stderr: node2 Pulled (cluster.py:147, run_and_check) 2025-05-23 21:10:32 [ 671 ] DEBUG : Stderr: azurite1 Pulled (cluster.py:147, run_and_check) 2025-05-23 21:10:32 [ 671 ] INFO : Trying to create Minio instance by command docker compose --project-name rootteststorageiceberg-gw1 --env-file /ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d (cluster.py:2993, start) 2025-05-23 21:10:32 [ 671 ] DEBUG : Command:[docker compose --project-name rootteststorageiceberg-gw1 --env-file /ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] (cluster.py:121, run_and_check) 2025-05-23 21:10:32 [ 671 ] DEBUG : Stderr:time="2025-05-23T21:10:32Z" level=trace msg="Docker Desktop integration not enabled" (cluster.py:147, run_and_check) 2025-05-23 21:10:32 [ 671 ] DEBUG : Stderr: Network rootteststorageiceberg-gw1_default Creating (cluster.py:147, run_and_check) 2025-05-23 21:10:32 [ 671 ] DEBUG : Stderr: Network rootteststorageiceberg-gw1_default Created (cluster.py:147, run_and_check) 2025-05-23 21:10:32 [ 671 ] DEBUG : Stderr: Volume "rootteststorageiceberg-gw1_data1-1" Creating (cluster.py:147, run_and_check) 2025-05-23 21:10:32 [ 671 ] DEBUG : Stderr: Volume "rootteststorageiceberg-gw1_data1-1" Created (cluster.py:147, run_and_check) 2025-05-23 21:10:32 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-proxy1-1 Creating (cluster.py:147, run_and_check) 2025-05-23 21:10:32 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-proxy2-1 Creating (cluster.py:147, run_and_check) 2025-05-23 21:10:32 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-proxy2-1 Created (cluster.py:147, run_and_check) 2025-05-23 21:10:32 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-proxy1-1 Created (cluster.py:147, run_and_check) 2025-05-23 21:10:32 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-minio1-1 Creating (cluster.py:147, run_and_check) 2025-05-23 21:10:32 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-resolver-1 Creating (cluster.py:147, run_and_check) 2025-05-23 21:10:32 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-resolver-1 Created (cluster.py:147, run_and_check) 2025-05-23 21:10:32 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-minio1-1 Created (cluster.py:147, run_and_check) 2025-05-23 21:10:32 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-proxy1-1 Starting (cluster.py:147, run_and_check) 2025-05-23 21:10:32 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-proxy2-1 Starting (cluster.py:147, run_and_check) 2025-05-23 21:10:32 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-proxy1-1 Started (cluster.py:147, run_and_check) 2025-05-23 21:10:32 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-proxy2-1 Started (cluster.py:147, run_and_check) 2025-05-23 21:10:32 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-minio1-1 Starting (cluster.py:147, run_and_check) 2025-05-23 21:10:32 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-resolver-1 Starting (cluster.py:147, run_and_check) 2025-05-23 21:10:32 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-minio1-1 Started (cluster.py:147, run_and_check) 2025-05-23 21:10:32 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-resolver-1 Started (cluster.py:147, run_and_check) 2025-05-23 21:10:32 [ 671 ] DEBUG : Stderr:time="2025-05-23T21:10:32Z" level=debug msg="otel error" error="" (cluster.py:147, run_and_check) 2025-05-23 21:10:32 [ 671 ] DEBUG : Stderr:time="2025-05-23T21:10:32Z" level=debug msg="otel error" error="" (cluster.py:147, run_and_check) 2025-05-23 21:10:32 [ 671 ] INFO : Trying to connect to Minio... (cluster.py:2999, start) 2025-05-23 21:10:32 [ 671 ] DEBUG : get_instance_ip instance_name=minio1 (cluster.py:1999, get_instance_ip) 2025-05-23 21:10:32 [ 671 ] DEBUG : http://localhost:None "GET /v1.46/containers/rootteststorageiceberg-gw1-minio1-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-05-23 21:10:32 [ 671 ] DEBUG : get_instance_ip instance_name=proxy1 (cluster.py:1999, get_instance_ip) 2025-05-23 21:10:32 [ 671 ] DEBUG : http://localhost:None "GET /v1.46/containers/rootteststorageiceberg-gw1-proxy1-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-05-23 21:10:32 [ 671 ] DEBUG : Starting new HTTP connection (1): 172.16.1.4:9001 (connectionpool.py:245, _new_conn) 2025-05-23 21:10:32 [ 671 ] DEBUG : Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) (retry.py:517, increment) 2025-05-23 21:10:32 [ 671 ] WARNING : Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / (connectionpool.py:872, urlopen) 2025-05-23 21:10:32 [ 671 ] DEBUG : Starting new HTTP connection (2): 172.16.1.4:9001 (connectionpool.py:245, _new_conn) 2025-05-23 21:10:32 [ 671 ] DEBUG : Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) (retry.py:517, increment) 2025-05-23 21:10:32 [ 671 ] WARNING : Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / (connectionpool.py:872, urlopen) 2025-05-23 21:10:32 [ 671 ] DEBUG : Starting new HTTP connection (3): 172.16.1.4:9001 (connectionpool.py:245, _new_conn) 2025-05-23 21:10:32 [ 671 ] DEBUG : Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) (retry.py:517, increment) 2025-05-23 21:10:32 [ 671 ] WARNING : Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / (connectionpool.py:872, urlopen) 2025-05-23 21:10:32 [ 671 ] DEBUG : Starting new HTTP connection (4): 172.16.1.4:9001 (connectionpool.py:245, _new_conn) 2025-05-23 21:10:32 [ 671 ] DEBUG : Can't connect to Minio: HTTPConnectionPool(host='172.16.1.4', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) (cluster.py:2516, wait_minio_to_start) 2025-05-23 21:10:33 [ 671 ] DEBUG : Starting new HTTP connection (5): 172.16.1.4:9001 (connectionpool.py:245, _new_conn) 2025-05-23 21:10:33 [ 671 ] DEBUG : http://172.16.1.4:9001 "GET / HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:33 [ 671 ] DEBUG : Connected to Minio. (cluster.py:2496, wait_minio_to_start) 2025-05-23 21:10:33 [ 671 ] DEBUG : http://172.16.1.4:9001 "GET /root?location= HTTP/1.1" 404 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:33 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:33 [ 671 ] DEBUG : S3 bucket 'root' created (cluster.py:2511, wait_minio_to_start) 2025-05-23 21:10:33 [ 671 ] DEBUG : http://172.16.1.4:9001 "GET /root2?location= HTTP/1.1" 404 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:33 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root2 HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:33 [ 671 ] DEBUG : S3 bucket 'root2' created (cluster.py:2511, wait_minio_to_start) 2025-05-23 21:10:33 [ 671 ] INFO : Trying to create Azurite instance by command docker compose --project-name rootteststorageiceberg-gw1 --env-file /ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml --verbose up -d (cluster.py:3004, start) 2025-05-23 21:10:33 [ 671 ] DEBUG : Command:[docker compose --project-name rootteststorageiceberg-gw1 --env-file /ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml --verbose up -d] (cluster.py:121, run_and_check) 2025-05-23 21:10:34 [ 671 ] DEBUG : Stderr:time="2025-05-23T21:10:33Z" level=trace msg="Docker Desktop integration not enabled" (cluster.py:147, run_and_check) 2025-05-23 21:10:34 [ 671 ] DEBUG : Stderr:time="2025-05-23T21:10:33Z" level=warning msg="Found orphan containers ([rootteststorageiceberg-gw1-minio1-1 rootteststorageiceberg-gw1-resolver-1 rootteststorageiceberg-gw1-proxy2-1 rootteststorageiceberg-gw1-proxy1-1]) for this project. If you removed or renamed this service in your compose file, you can run this command with the --remove-orphans flag to clean it up." (cluster.py:147, run_and_check) 2025-05-23 21:10:34 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-azurite1-1 Creating (cluster.py:147, run_and_check) 2025-05-23 21:10:34 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-azurite1-1 Created (cluster.py:147, run_and_check) 2025-05-23 21:10:34 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-azurite1-1 Starting (cluster.py:147, run_and_check) 2025-05-23 21:10:34 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-azurite1-1 Started (cluster.py:147, run_and_check) 2025-05-23 21:10:34 [ 671 ] DEBUG : Stderr:time="2025-05-23T21:10:34Z" level=debug msg="otel error" error="" (cluster.py:147, run_and_check) 2025-05-23 21:10:34 [ 671 ] DEBUG : Stderr:time="2025-05-23T21:10:34Z" level=debug msg="otel error" error="" (cluster.py:147, run_and_check) 2025-05-23 21:10:34 [ 671 ] INFO : Trying to connect to Azurite (cluster.py:3018, start) 2025-05-23 21:10:35 [ 671 ] DEBUG : Command to send: m d o7 e (clientserver.py:501, send_command) 2025-05-23 21:10:35 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:35 [ 671 ] DEBUG : Command to send: m d o8 e (clientserver.py:501, send_command) 2025-05-23 21:10:35 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:35 [ 671 ] DEBUG : Command to send: m d o0 e (clientserver.py:501, send_command) 2025-05-23 21:10:35 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:35 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/?restype=REDACTED&comp=REDACTED' Request method: 'GET' Request headers: 'x-ms-version': 'REDACTED' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '5e6c10ae-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' No body was attached to the request (_universal.py:514, on_request) 2025-05-23 21:10:35 [ 671 ] DEBUG : Starting new HTTP connection (1): 127.0.0.1:30050 (connectionpool.py:245, _new_conn) 2025-05-23 21:10:35 [ 671 ] DEBUG : http://127.0.0.1:30050 "GET /devstoreaccount1/?restype=account&comp=properties HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:35 [ 671 ] INFO : Response status: 200 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'x-ms-client-request-id': '5e6c10ae-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '7297d968-9208-4237-85a0-98677478b94c' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:35 GMT' 'x-ms-sku-name': 'REDACTED' 'x-ms-account-kind': 'REDACTED' 'x-ms-is-hns-enabled': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:35 [ 671 ] DEBUG : {'client_request_id': '5e6c10ae-381a-11f0-90ba-0242ac110002', 'request_id': '7297d968-9208-4237-85a0-98677478b94c', 'version': '2025-05-05', 'date': datetime.datetime(2025, 5, 23, 21, 10, 35, tzinfo=datetime.timezone.utc), 'sku_name': 'Standard_RAGRS', 'account_kind': 'StorageV2', 'is_hns_enabled': False} (cluster.py:2544, wait_azurite_to_start) 2025-05-23 21:10:35 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/?comp=REDACTED&prefix=REDACTED&include=REDACTED' Request method: 'GET' Request headers: 'x-ms-version': 'REDACTED' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '5e7220ac-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' No body was attached to the request (_universal.py:514, on_request) 2025-05-23 21:10:35 [ 671 ] DEBUG : http://127.0.0.1:30050 "GET /devstoreaccount1/?comp=list&prefix=azurite-container&include= HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-05-23 21:10:35 [ 671 ] INFO : Response status: 200 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'x-ms-client-request-id': '5e7220ac-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '14f3ee3f-8b01-41dd-abdc-942b9f6e64ec' 'x-ms-version': 'REDACTED' 'content-type': 'application/xml' 'Date': 'Fri, 23 May 2025 21:10:35 GMT' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Transfer-Encoding': 'chunked' (_universal.py:550, on_response) 2025-05-23 21:10:35 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/azurite-container?restype=REDACTED' Request method: 'GET' Request headers: 'x-ms-version': 'REDACTED' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '5e73d19a-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' No body was attached to the request (_universal.py:514, on_request) 2025-05-23 21:10:35 [ 671 ] DEBUG : http://127.0.0.1:30050 "GET /devstoreaccount1/azurite-container?restype=container HTTP/1.1" 404 None (connectionpool.py:547, _make_request) 2025-05-23 21:10:35 [ 671 ] INFO : Response status: 404 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'x-ms-error-code': 'ContainerNotFound' 'x-ms-request-id': '628c6ef1-962b-4dfd-9d4c-6d11a438e88b' 'content-type': 'application/xml' 'Date': 'Fri, 23 May 2025 21:10:35 GMT' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Transfer-Encoding': 'chunked' (_universal.py:550, on_response) 2025-05-23 21:10:35 [ 671 ] DEBUG : azurite container 'azurite-container' doesn't exist, creating it (cluster.py:2566, wait_azurite_to_start) 2025-05-23 21:10:35 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/azurite-container?restype=REDACTED' Request method: 'PUT' Request headers: 'x-ms-version': 'REDACTED' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '5e751564-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' No body was attached to the request (_universal.py:514, on_request) 2025-05-23 21:10:35 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/azurite-container?restype=container HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:35 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x1BE2542BE509980"' 'last-modified': 'Fri, 23 May 2025 21:10:35 GMT' 'x-ms-client-request-id': '5e751564-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '7fd4cf69-c336-403b-8e89-2e092f337122' 'x-ms-version': 'REDACTED' 'Date': 'Fri, 23 May 2025 21:10:35 GMT' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:35 [ 671 ] DEBUG : ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/.env --project-name rootteststorageiceberg-gw1 --file /ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml --file /ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/node3/docker-compose.yml up -d --no-recreate') (cluster.py:3061, start) 2025-05-23 21:10:35 [ 671 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/.env --project-name rootteststorageiceberg-gw1 --file /ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml --file /ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/node3/docker-compose.yml up -d --no-recreate] (cluster.py:121, run_and_check) 2025-05-23 21:10:35 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-proxy2-1 Running (cluster.py:147, run_and_check) 2025-05-23 21:10:35 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-node3-1 Creating (cluster.py:147, run_and_check) 2025-05-23 21:10:35 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-azurite1-1 Running (cluster.py:147, run_and_check) 2025-05-23 21:10:35 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-proxy1-1 Running (cluster.py:147, run_and_check) 2025-05-23 21:10:35 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-node2-1 Creating (cluster.py:147, run_and_check) 2025-05-23 21:10:35 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-resolver-1 Running (cluster.py:147, run_and_check) 2025-05-23 21:10:35 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-minio1-1 Running (cluster.py:147, run_and_check) 2025-05-23 21:10:35 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-node1-1 Creating (cluster.py:147, run_and_check) 2025-05-23 21:10:35 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-node3-1 Created (cluster.py:147, run_and_check) 2025-05-23 21:10:35 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-node1-1 Created (cluster.py:147, run_and_check) 2025-05-23 21:10:35 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-node2-1 Created (cluster.py:147, run_and_check) 2025-05-23 21:10:35 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-node2-1 Starting (cluster.py:147, run_and_check) 2025-05-23 21:10:35 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-node3-1 Starting (cluster.py:147, run_and_check) 2025-05-23 21:10:35 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-node1-1 Starting (cluster.py:147, run_and_check) 2025-05-23 21:10:35 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-node2-1 Started (cluster.py:147, run_and_check) 2025-05-23 21:10:35 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-node1-1 Started (cluster.py:147, run_and_check) 2025-05-23 21:10:35 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-node3-1 Started (cluster.py:147, run_and_check) 2025-05-23 21:10:35 [ 671 ] DEBUG : ClickHouse instance created (cluster.py:3069, start) 2025-05-23 21:10:35 [ 671 ] DEBUG : get_instance_ip instance_name=node1 (cluster.py:1999, get_instance_ip) 2025-05-23 21:10:35 [ 671 ] DEBUG : http://localhost:None "GET /v1.46/containers/rootteststorageiceberg-gw1-node1-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-05-23 21:10:35 [ 671 ] DEBUG : get_instance_ip instance_name=node1 (cluster.py:2009, get_instance_global_ipv6) 2025-05-23 21:10:35 [ 671 ] DEBUG : http://localhost:None "GET /v1.46/containers/rootteststorageiceberg-gw1-node1-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-05-23 21:10:35 [ 671 ] DEBUG : Waiting for ClickHouse start in node1, ip: 172.16.1.9... (cluster.py:3077, start) 2025-05-23 21:10:35 [ 671 ] DEBUG : http://localhost:None "GET /v1.46/containers/rootteststorageiceberg-gw1-node1-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-05-23 21:10:35 [ 671 ] DEBUG : http://localhost:None "GET /v1.46/containers/61eebc3b9edb8b0def99391d31757e8886ffe27d5edd65c61f4aa6d58eebc185/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-05-23 21:10:36 [ 671 ] DEBUG : http://localhost:None "GET /v1.46/containers/61eebc3b9edb8b0def99391d31757e8886ffe27d5edd65c61f4aa6d58eebc185/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-05-23 21:10:36 [ 671 ] DEBUG : http://localhost:None "GET /v1.46/containers/61eebc3b9edb8b0def99391d31757e8886ffe27d5edd65c61f4aa6d58eebc185/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-05-23 21:10:36 [ 671 ] DEBUG : http://localhost:None "GET /v1.46/containers/61eebc3b9edb8b0def99391d31757e8886ffe27d5edd65c61f4aa6d58eebc185/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-05-23 21:10:36 [ 671 ] DEBUG : http://localhost:None "GET /v1.46/containers/61eebc3b9edb8b0def99391d31757e8886ffe27d5edd65c61f4aa6d58eebc185/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-05-23 21:10:36 [ 671 ] DEBUG : ClickHouse node1 started (cluster.py:3081, start) 2025-05-23 21:10:36 [ 671 ] DEBUG : get_instance_ip instance_name=node2 (cluster.py:1999, get_instance_ip) 2025-05-23 21:10:36 [ 671 ] DEBUG : http://localhost:None "GET /v1.46/containers/rootteststorageiceberg-gw1-node2-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-05-23 21:10:36 [ 671 ] DEBUG : get_instance_ip instance_name=node2 (cluster.py:2009, get_instance_global_ipv6) 2025-05-23 21:10:36 [ 671 ] DEBUG : http://localhost:None "GET /v1.46/containers/rootteststorageiceberg-gw1-node2-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-05-23 21:10:36 [ 671 ] DEBUG : Waiting for ClickHouse start in node2, ip: 172.16.1.7... (cluster.py:3077, start) 2025-05-23 21:10:36 [ 671 ] DEBUG : http://localhost:None "GET /v1.46/containers/rootteststorageiceberg-gw1-node2-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-05-23 21:10:36 [ 671 ] DEBUG : http://localhost:None "GET /v1.46/containers/5a115ae55a4d9d2a48f7ca70db27952f2cfd773ce79389093e8e83314cfb3b69/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-05-23 21:10:36 [ 671 ] DEBUG : ClickHouse node2 started (cluster.py:3081, start) 2025-05-23 21:10:36 [ 671 ] DEBUG : get_instance_ip instance_name=node3 (cluster.py:1999, get_instance_ip) 2025-05-23 21:10:36 [ 671 ] DEBUG : http://localhost:None "GET /v1.46/containers/rootteststorageiceberg-gw1-node3-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-05-23 21:10:36 [ 671 ] DEBUG : get_instance_ip instance_name=node3 (cluster.py:2009, get_instance_global_ipv6) 2025-05-23 21:10:36 [ 671 ] DEBUG : http://localhost:None "GET /v1.46/containers/rootteststorageiceberg-gw1-node3-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-05-23 21:10:36 [ 671 ] DEBUG : Waiting for ClickHouse start in node3, ip: 172.16.1.8... (cluster.py:3077, start) 2025-05-23 21:10:36 [ 671 ] DEBUG : http://localhost:None "GET /v1.46/containers/rootteststorageiceberg-gw1-node3-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-05-23 21:10:36 [ 671 ] DEBUG : http://localhost:None "GET /v1.46/containers/b983c93f2c6b4bb2e4ea021d4f4201e9acc084004110d891e0034e3f3c4b878e/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-05-23 21:10:36 [ 671 ] DEBUG : ClickHouse node3 started (cluster.py:3081, start) 2025-05-23 21:10:36 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root?policy= HTTP/1.1" 204 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:36 [ 671 ] DEBUG : http://172.16.1.4:9001 "GET /root-with-auth?location= HTTP/1.1" 404 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:36 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root-with-auth HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:36 [ 671 ] INFO : S3 bucket created (test.py:100, started_cluster) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: r u SparkConf rj e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.SparkConf (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: i org.apache.spark.SparkConf bTrue e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yro26 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o26 set sspark.app.name sspark_test e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yro27 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o26 set sspark.master slocal e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yro28 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o26 set sspark.sql.catalog.spark_catalog sorg.apache.iceberg.spark.SparkSessionCatalog e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yro29 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o26 set sspark.sql.catalog.local sorg.apache.iceberg.spark.SparkCatalog e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yro30 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o26 set sspark.sql.catalog.spark_catalog.type shadoop e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yro31 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o26 set sspark.sql.catalog.spark_catalog.warehouse s/iceberg_data e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yro32 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o26 set sspark.sql.extensions sorg.apache.iceberg.spark.extensions.IcebergSparkSessionExtensions e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yro33 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o26 get sspark.executor.allowSparkContext sfalse e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ysfalse (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o26 contains sspark.serializer.objectStreamReset e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ybfalse (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o26 set sspark.serializer.objectStreamReset s100 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yro34 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o26 contains sspark.rdd.compress e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ybfalse (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o26 set sspark.rdd.compress sTrue e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yro35 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o26 contains sspark.master e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o26 contains sspark.app.name e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o26 contains sspark.master e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o26 get sspark.master e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yslocal (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o26 contains sspark.app.name e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o26 get sspark.app.name e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ysspark_test (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o26 contains sspark.home e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ybfalse (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o26 getAll e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yto36 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: a e o36 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yi13 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: a g o36 i0 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yro37 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o37 _1 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ysspark.master (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o37 _2 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yslocal (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: a e o36 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yi13 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: a g o36 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yro38 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o38 _1 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ysspark.sql.catalog.local (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o38 _2 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ysorg.apache.iceberg.spark.SparkCatalog (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: a e o36 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yi13 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: a g o36 i2 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yro39 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o39 _1 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ysspark.app.name (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o39 _2 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ysspark_test (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: a e o36 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yi13 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: a g o36 i3 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yro40 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o40 _1 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ysspark.rdd.compress (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o40 _2 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ysTrue (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: a e o36 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yi13 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: a g o36 i4 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yro41 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o41 _1 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ysspark.serializer.objectStreamReset (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o41 _2 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ys100 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: a e o36 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yi13 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: a g o36 i5 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yro42 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o42 _1 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ysspark.sql.catalog.spark_catalog.warehouse (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o42 _2 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ys/iceberg_data (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: a e o36 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yi13 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: a g o36 i6 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yro43 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o43 _1 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ysspark.app.submitTime (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o43 _2 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ys1748034568941 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: a e o36 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yi13 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: a g o36 i7 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yro44 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o44 _1 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ysspark.submit.pyFiles (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o44 _2 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ys (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: a e o36 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yi13 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: a g o36 i8 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yro45 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o45 _1 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ysspark.sql.catalog.spark_catalog (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o45 _2 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ysorg.apache.iceberg.spark.SparkSessionCatalog (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: a e o36 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yi13 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: a g o36 i9 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yro46 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o46 _1 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ysspark.submit.deployMode (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o46 _2 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ysclient (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: a e o36 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yi13 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: a g o36 i10 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yro47 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o47 _1 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ysspark.sql.catalog.spark_catalog.type (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o47 _2 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yshadoop (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: a e o36 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yi13 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: a g o36 i11 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yro48 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o48 _1 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ysspark.ui.showConsoleProgress (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o48 _2 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ystrue (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: a e o36 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yi13 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: a g o36 i12 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yro49 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o49 _1 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ysspark.sql.extensions (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o49 _2 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ysorg.apache.iceberg.spark.extensions.IcebergSparkSessionExtensions (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: a e o36 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yi13 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: r u JavaSparkContext rj e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.java.JavaSparkContext (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: i org.apache.spark.api.java.JavaSparkContext ro26 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yro50 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yro51 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o51 conf e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yro52 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: r u PythonAccumulatorV2 rj e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonAccumulatorV2 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: i org.apache.spark.api.python.PythonAccumulatorV2 s127.0.0.1 i58833 s2fd8eb7b3b011407aa2bbab9377dec2254c5b5a067bf7a2fd337da88d2e9b8d9 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yro53 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yro54 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o54 register ro53 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils isEncryptionEnabled e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils isEncryptionEnabled ro50 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ybfalse (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils getPythonAuthSocketTimeout e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils getPythonAuthSocketTimeout ro50 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yL15 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils getSparkBufferSize e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils getSparkBufferSize ro50 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yi65536 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: r u org.apache.spark.SparkFiles rj e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.SparkFiles (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: r m org.apache.spark.SparkFiles getRootDirectory e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.SparkFiles getRootDirectory e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ys/tmp/spark-d65df9db-163c-4131-b033-69c6f0e90935/userFiles-49c5b900-7fa8-4e7b-8ae4-945422905d79 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o52 get sspark.submit.pyFiles s e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ys (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: r u org.apache.spark.util rj e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: r u org.apache.spark.util.Utils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.util.Utils (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: r m org.apache.spark.util.Utils getLocalDir e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yro55 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o55 conf e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yro56 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.util.Utils getLocalDir ro56 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ys/tmp/spark-d65df9db-163c-4131-b033-69c6f0e90935 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: r u org.apache.spark.util rj e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: r u org.apache.spark.util.Utils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.util.Utils (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: r m org.apache.spark.util.Utils createTempDir e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.util.Utils createTempDir s/tmp/spark-d65df9db-163c-4131-b033-69c6f0e90935 spyspark e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yro57 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o57 getAbsolutePath e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ys/tmp/spark-d65df9db-163c-4131-b033-69c6f0e90935/pyspark-83e8e1cf-6529-46a2-95ad-f3680ca05841 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o52 get sspark.python.profile sfalse e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ysfalse (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getDefaultSession e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getDefaultSession e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yro58 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o58 isDefined e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ybfalse (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yro59 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yao60 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o60 put sspark.app.name sspark_test e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yn (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o60 put sspark.master slocal e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yn (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o60 put sspark.sql.catalog.spark_catalog sorg.apache.iceberg.spark.SparkSessionCatalog e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yn (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o60 put sspark.sql.catalog.local sorg.apache.iceberg.spark.SparkCatalog e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yn (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o60 put sspark.sql.catalog.spark_catalog.type shadoop e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yn (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o60 put sspark.sql.catalog.spark_catalog.warehouse s/iceberg_data e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yn (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o60 put sspark.sql.extensions sorg.apache.iceberg.spark.extensions.IcebergSparkSessionExtensions e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yn (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: i org.apache.spark.sql.SparkSession ro59 ro60 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yro61 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession setDefaultSession e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession setDefaultSession ro61 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession setActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession setActiveSession ro61 e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer?restype=REDACTED' Request method: 'PUT' Request headers: 'x-ms-version': 'REDACTED' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '5f2997aa-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' No body was attached to the request (_universal.py:514, on_request) 2025-05-23 21:10:36 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer?restype=container HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:36 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x20A66C302979AA0"' 'last-modified': 'Fri, 23 May 2025 21:10:36 GMT' 'x-ms-client-request-id': '5f2997aa-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': 'b96e1044-3314-469e-bd84-6f9a09e420f4' 'x-ms-version': 'REDACTED' 'Date': 'Fri, 23 May 2025 21:10:36 GMT' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) ----------------------------- Captured stdout call ----------------------------- 25/05/23 21:10:39 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:39 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:39 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:39 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:41 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:41 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. {} {} {} 25/05/23 21:10:42 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:42 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:42 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:42 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:42 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:42 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. {} {} {} 25/05/23 21:10:43 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:43 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:43 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:43 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:43 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:43 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. {} {} {} ----------------------------- Captured stderr call ----------------------------- [Stage 1:> (0 + 1) / 1] ------------------------------ Captured log call ------------------------------- 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yro62 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o62 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:36 [ 671 ] DEBUG : Command to send: c o61 range i0 i100 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Command to send: m d o27 e (clientserver.py:501, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Command to send: m d o28 e (clientserver.py:501, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Command to send: m d o29 e (clientserver.py:501, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Command to send: m d o30 e (clientserver.py:501, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Command to send: m d o31 e (clientserver.py:501, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Command to send: m d o32 e (clientserver.py:501, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Command to send: m d o33 e (clientserver.py:501, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Command to send: m d o34 e (clientserver.py:501, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Command to send: m d o35 e (clientserver.py:501, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Command to send: m d o37 e (clientserver.py:501, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Command to send: m d o38 e (clientserver.py:501, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Command to send: m d o39 e (clientserver.py:501, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Command to send: m d o40 e (clientserver.py:501, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Command to send: m d o41 e (clientserver.py:501, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Command to send: m d o42 e (clientserver.py:501, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Command to send: m d o43 e (clientserver.py:501, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Command to send: m d o44 e (clientserver.py:501, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Command to send: m d o45 e (clientserver.py:501, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Command to send: m d o36 e (clientserver.py:501, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Command to send: m d o60 e (clientserver.py:501, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Command to send: m d o47 e (clientserver.py:501, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Command to send: m d o48 e (clientserver.py:501, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Command to send: m d o49 e (clientserver.py:501, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Command to send: m d o51 e (clientserver.py:501, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Command to send: m d o54 e (clientserver.py:501, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Command to send: m d o55 e (clientserver.py:501, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Command to send: m d o56 e (clientserver.py:501, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Command to send: m d o57 e (clientserver.py:501, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Command to send: m d o58 e (clientserver.py:501, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Command to send: m d o59 e (clientserver.py:501, send_command) 2025-05-23 21:10:37 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !yro63 (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !ylo64 (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: c o64 add sa e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro64 e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !yro65 (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: c o63 toDF ro65 e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !yro66 (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !yro67 (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: c o67 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: c o61 range i1 i101 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !yro68 (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !ylo69 (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: c o69 add sb e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro69 e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !yro70 (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: c o68 toDF ro70 e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !yro71 (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: c o71 apply sb e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !yro72 (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !yro73 (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: c o73 isDefined e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !yro74 (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: c o74 get e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !yro75 (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !yro76 (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !yao77 (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: c o76 applyModifiableSettings ro75 ro77 e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: c o61 parseDataType s"string" e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !yro78 (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: c o72 cast ro78 e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !yro79 (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: c o71 withColumn sb ro79 e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !yro80 (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !yro81 (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !yro82 (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !ylo83 (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: c o83 add ro82 e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro83 e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !yro84 (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro84 e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !yro85 (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: c o81 over ro85 e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !yro86 (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: c o66 withColumn srow_index ro86 e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !yro87 (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !yro88 (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !yro89 (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !ylo90 (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: c o90 add ro89 e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro90 e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !yro91 (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro91 e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !yro92 (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: c o88 over ro92 e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !yro93 (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: c o80 withColumn srow_index ro93 e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !yro94 (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !ylo95 (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: c o95 add srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro95 e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !yro96 (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: c o87 join ro94 ro96 sinner e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !yro97 (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: c o97 drop srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !yro98 (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: c o98 writeTo stest_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !yro99 (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: c o99 tableProperty sformat-version s1 e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !yro100 (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: c o99 using siceberg e (clientserver.py:501, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Answer received: !yro101 (clientserver.py:512, send_command) 2025-05-23 21:10:38 [ 671 ] DEBUG : Command to send: c o99 create e (clientserver.py:501, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Command to send: m d o64 e (clientserver.py:501, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Command to send: m d o69 e (clientserver.py:501, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Command to send: m d o77 e (clientserver.py:501, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Command to send: m d o83 e (clientserver.py:501, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Command to send: m d o90 e (clientserver.py:501, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Command to send: m d o62 e (clientserver.py:501, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Command to send: m d o63 e (clientserver.py:501, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Command to send: m d o65 e (clientserver.py:501, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Command to send: m d o66 e (clientserver.py:501, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Command to send: m d o67 e (clientserver.py:501, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Command to send: m d o68 e (clientserver.py:501, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Command to send: m d o70 e (clientserver.py:501, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Command to send: m d o71 e (clientserver.py:501, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Command to send: m d o72 e (clientserver.py:501, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Command to send: m d o73 e (clientserver.py:501, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Command to send: m d o74 e (clientserver.py:501, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Command to send: m d o76 e (clientserver.py:501, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Command to send: m d o78 e (clientserver.py:501, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Command to send: m d o79 e (clientserver.py:501, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Command to send: m d o81 e (clientserver.py:501, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Command to send: m d o82 e (clientserver.py:501, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Command to send: m d o84 e (clientserver.py:501, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Command to send: m d o85 e (clientserver.py:501, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Command to send: m d o86 e (clientserver.py:501, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Command to send: m d o89 e (clientserver.py:501, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Command to send: m d o91 e (clientserver.py:501, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Command to send: m d o95 e (clientserver.py:501, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Command to send: m d o100 e (clientserver.py:501, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Command to send: m d o101 e (clientserver.py:501, send_command) 2025-05-23 21:10:39 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/data/00000-1-338c07cd-61f1-424d-90d9-03bc38788e5e-00001.parquet' Request method: 'PUT' Request headers: 'Content-Length': '967' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '62a80ba0-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:42 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/data/00000-1-338c07cd-61f1-424d-90d9-03bc38788e5e-00001.parquet HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:42 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x21C4649B3B13700"' 'last-modified': 'Fri, 23 May 2025 21:10:42 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '62a80ba0-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '029b7cb0-a939-49e7-a791-31a48bf3a97f' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:42 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:42 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/5c792e49-68de-445f-a152-e2d54e086165-m0.avro' Request method: 'PUT' Request headers: 'Content-Length': '5823' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '62aad254-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:42 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/5c792e49-68de-445f-a152-e2d54e086165-m0.avro HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:42 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x21A3CD3010E48E0"' 'last-modified': 'Fri, 23 May 2025 21:10:42 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '62aad254-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '99c8caaf-bfa2-4a64-9401-73da5c5458b5' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:42 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:42 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/snap-7991125359598869457-1-5c792e49-68de-445f-a152-e2d54e086165.avro' Request method: 'PUT' Request headers: 'Content-Length': '3794' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '62accc58-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:42 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/snap-7991125359598869457-1-5c792e49-68de-445f-a152-e2d54e086165.avro HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:42 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x26A7967B9556A00"' 'last-modified': 'Fri, 23 May 2025 21:10:42 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '62accc58-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '49b44872-f5da-4419-8187-bb01aba7b947' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:42 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:42 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/version-hint.text' Request method: 'PUT' Request headers: 'Content-Length': '1' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '62ae8a2a-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:42 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/version-hint.text HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:42 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x22DFAE3630F63A0"' 'last-modified': 'Fri, 23 May 2025 21:10:42 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '62ae8a2a-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '49908ce2-7d7b-494c-9301-66a555ed6cc1' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:42 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:42 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/v1.metadata.json' Request method: 'PUT' Request headers: 'Content-Length': '2180' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '62b04130-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:42 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/v1.metadata.json HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:42 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x1B994BCC7874090"' 'last-modified': 'Fri, 23 May 2025 21:10:42 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '62b04130-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': 'a6261a16-0d6d-4e3d-bf5c-5805bc011219' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:42 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:42 [ 671 ] INFO : Adding another dataframe. result files: ['/iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/data/00000-1-338c07cd-61f1-424d-90d9-03bc38788e5e-00001.parquet', '/iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/5c792e49-68de-445f-a152-e2d54e086165-m0.avro', '/iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/snap-7991125359598869457-1-5c792e49-68de-445f-a152-e2d54e086165.avro', '/iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/version-hint.text', '/iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/v1.metadata.json'] (test.py:666, add_df) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !yro102 (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: c o102 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: c o61 range i0 i100 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !yro103 (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !ylo104 (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: c o104 add sa e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro104 e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !yro105 (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: c o103 toDF ro105 e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !yro106 (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !yro107 (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: c o107 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: c o61 range i1 i101 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !yro108 (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !ylo109 (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: c o109 add sb e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro109 e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !yro110 (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: c o108 toDF ro110 e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !yro111 (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: c o111 apply sb e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !yro112 (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !yro113 (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: c o113 isDefined e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !yro114 (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: c o114 get e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !yro115 (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !yro116 (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !yao117 (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: c o116 applyModifiableSettings ro115 ro117 e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: c o61 parseDataType s"string" e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !yro118 (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: c o112 cast ro118 e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !yro119 (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: c o111 withColumn sb ro119 e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !yro120 (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !yro121 (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !yro122 (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !ylo123 (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: c o123 add ro122 e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro123 e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !yro124 (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro124 e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !yro125 (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: c o121 over ro125 e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !yro126 (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: c o106 withColumn srow_index ro126 e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !yro127 (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !yro128 (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !yro129 (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !ylo130 (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: c o130 add ro129 e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro130 e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !yro131 (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro131 e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !yro132 (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: c o128 over ro132 e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !yro133 (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: c o120 withColumn srow_index ro133 e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !yro134 (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !ylo135 (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: c o135 add srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro135 e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !yro136 (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: c o127 join ro134 ro136 sinner e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !yro137 (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: c o137 drop srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !yro138 (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: c o138 writeTo stest_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !yro139 (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Command to send: c o139 append e (clientserver.py:501, send_command) 2025-05-23 21:10:42 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:42 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/data/00000-3-803ee0fd-ab0b-4650-b3a0-920758eaf40b-00001.parquet' Request method: 'PUT' Request headers: 'Content-Length': '967' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '63035e10-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:43 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/data/00000-3-803ee0fd-ab0b-4650-b3a0-920758eaf40b-00001.parquet HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:43 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x1D1970371CD40C0"' 'last-modified': 'Fri, 23 May 2025 21:10:42 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '63035e10-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '69a2d486-c10f-45b6-baf1-c225d4e86a1f' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:42 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:43 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/data/00000-1-338c07cd-61f1-424d-90d9-03bc38788e5e-00001.parquet' Request method: 'PUT' Request headers: 'Content-Length': '967' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '630553fa-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:43 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/data/00000-1-338c07cd-61f1-424d-90d9-03bc38788e5e-00001.parquet HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:43 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x1C7A284CE938060"' 'last-modified': 'Fri, 23 May 2025 21:10:43 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '630553fa-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '110e3ecf-a1d0-457f-a00d-9268fdc1cce5' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:43 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:43 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/5c792e49-68de-445f-a152-e2d54e086165-m0.avro' Request method: 'PUT' Request headers: 'Content-Length': '5823' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '6307144c-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:43 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/5c792e49-68de-445f-a152-e2d54e086165-m0.avro HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:43 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x1F801B0E4A14890"' 'last-modified': 'Fri, 23 May 2025 21:10:43 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '6307144c-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': 'aca4a151-55c0-4054-ab16-1b11fe5caa3b' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:43 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:43 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/v2.metadata.json' Request method: 'PUT' Request headers: 'Content-Length': '3230' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '63092d40-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:43 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/v2.metadata.json HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:43 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x1DF869689F55C60"' 'last-modified': 'Fri, 23 May 2025 21:10:43 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '63092d40-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '9f9aee2a-b9e0-48a3-bd16-8a69a1a154b0' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:43 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:43 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/snap-7991125359598869457-1-5c792e49-68de-445f-a152-e2d54e086165.avro' Request method: 'PUT' Request headers: 'Content-Length': '3794' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '630aff80-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:43 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/snap-7991125359598869457-1-5c792e49-68de-445f-a152-e2d54e086165.avro HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:43 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x21FB8A483244600"' 'last-modified': 'Fri, 23 May 2025 21:10:43 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '630aff80-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '79653e90-1a45-45bf-8217-b923c0c4a4b0' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:43 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:43 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/aca152b8-867e-4de5-a280-d0e6a7d40120-m0.avro' Request method: 'PUT' Request headers: 'Content-Length': '5821' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '630cafce-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:43 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/aca152b8-867e-4de5-a280-d0e6a7d40120-m0.avro HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:43 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x2100BEA87B14420"' 'last-modified': 'Fri, 23 May 2025 21:10:43 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '630cafce-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': 'ca33cd8b-74c6-4d43-9aa9-9279b8bc24ac' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:43 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:43 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/snap-3999306977933642072-1-aca152b8-867e-4de5-a280-d0e6a7d40120.avro' Request method: 'PUT' Request headers: 'Content-Length': '3863' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '630e1508-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:43 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/snap-3999306977933642072-1-aca152b8-867e-4de5-a280-d0e6a7d40120.avro HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:43 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x21EBD7323C6A380"' 'last-modified': 'Fri, 23 May 2025 21:10:43 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '630e1508-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '2085343f-7fc6-4d3f-8b73-47893009e5c5' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:43 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:43 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/version-hint.text' Request method: 'PUT' Request headers: 'Content-Length': '1' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '630f6bce-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:43 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/version-hint.text HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:43 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x23E436AFE61C100"' 'last-modified': 'Fri, 23 May 2025 21:10:43 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '630f6bce-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': 'f191b079-ccaa-40d8-ab41-ba45da3e48fd' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:43 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:43 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/v1.metadata.json' Request method: 'PUT' Request headers: 'Content-Length': '2180' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '6310cad2-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:43 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/v1.metadata.json HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:43 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x1D845AB2CEB2250"' 'last-modified': 'Fri, 23 May 2025 21:10:43 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '6310cad2-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '68bf5bf6-d93d-4f80-b2fb-9ed31d0ff82a' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:43 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:43 [ 671 ] INFO : Adding another dataframe. result files: ['/iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/data/00000-3-803ee0fd-ab0b-4650-b3a0-920758eaf40b-00001.parquet', '/iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/data/00000-1-338c07cd-61f1-424d-90d9-03bc38788e5e-00001.parquet', '/iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/5c792e49-68de-445f-a152-e2d54e086165-m0.avro', '/iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/v2.metadata.json', '/iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/snap-7991125359598869457-1-5c792e49-68de-445f-a152-e2d54e086165.avro', '/iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/aca152b8-867e-4de5-a280-d0e6a7d40120-m0.avro', '/iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/snap-3999306977933642072-1-aca152b8-867e-4de5-a280-d0e6a7d40120.avro', '/iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/version-hint.text', '/iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/v1.metadata.json'] (test.py:666, add_df) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yro140 (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: c o140 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: c o61 range i0 i100 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yro141 (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !ylo142 (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: c o142 add sa e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro142 e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yro143 (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: c o141 toDF ro143 e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: m d o104 e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: m d o109 e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: m d o117 e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: m d o93 e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yro144 (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: m d o94 e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yro145 (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: c o145 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: m d o96 e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: c o61 range i1 i101 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: m d o97 e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: m d o98 e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: m d o99 e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: m d o102 e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: m d o103 e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: m d o105 e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: m d o107 e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: m d o108 e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: m d o110 e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: m d o111 e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: m d o112 e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: m d o113 e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: m d o114 e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: m d o116 e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: m d o118 e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: m d o119 e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: m d o123 e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: m d o130 e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: m d o135 e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: m d o142 e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yro146 (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !ylo147 (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: c o147 add sb e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro147 e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yro148 (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: c o146 toDF ro148 e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yro149 (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: c o149 apply sb e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yro150 (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yro151 (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: c o151 isDefined e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yro152 (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: c o152 get e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yro153 (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yro154 (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yao155 (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: c o154 applyModifiableSettings ro153 ro155 e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: c o61 parseDataType s"string" e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yro156 (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: c o150 cast ro156 e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yro157 (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: c o149 withColumn sb ro157 e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yro158 (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yro159 (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yro160 (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !ylo161 (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: c o161 add ro160 e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro161 e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yro162 (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro162 e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yro163 (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: c o159 over ro163 e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yro164 (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: c o144 withColumn srow_index ro164 e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yro165 (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yro166 (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yro167 (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !ylo168 (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: c o168 add ro167 e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro168 e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yro169 (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro169 e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yro170 (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: c o166 over ro170 e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yro171 (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: c o158 withColumn srow_index ro171 e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yro172 (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !ylo173 (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: c o173 add srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro173 e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yro174 (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: c o165 join ro172 ro174 sinner e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yro175 (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: c o175 drop srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yro176 (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: c o176 writeTo stest_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yro177 (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Command to send: c o177 append e (clientserver.py:501, send_command) 2025-05-23 21:10:43 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:43 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/data/00000-5-10122230-5d9c-476b-a009-a874758d5f10-00001.parquet' Request method: 'PUT' Request headers: 'Content-Length': '967' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '634b5350-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:43 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/data/00000-5-10122230-5d9c-476b-a009-a874758d5f10-00001.parquet HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:43 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x1F04E4DD2AAF0D0"' 'last-modified': 'Fri, 23 May 2025 21:10:43 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '634b5350-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '1cef7736-2ae4-45d8-bac9-79e264110f87' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:43 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:43 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/data/00000-3-803ee0fd-ab0b-4650-b3a0-920758eaf40b-00001.parquet' Request method: 'PUT' Request headers: 'Content-Length': '967' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '634d8166-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:43 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/data/00000-3-803ee0fd-ab0b-4650-b3a0-920758eaf40b-00001.parquet HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:43 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x20D585743D1F4C0"' 'last-modified': 'Fri, 23 May 2025 21:10:43 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '634d8166-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '8ef99512-5977-47d2-8f57-40f2c4b80ee0' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:43 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:43 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/data/00000-1-338c07cd-61f1-424d-90d9-03bc38788e5e-00001.parquet' Request method: 'PUT' Request headers: 'Content-Length': '967' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '634f244e-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:43 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/data/00000-1-338c07cd-61f1-424d-90d9-03bc38788e5e-00001.parquet HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:43 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x1DE89CE2D9BDB00"' 'last-modified': 'Fri, 23 May 2025 21:10:43 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '634f244e-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': 'd4ba014f-969a-4bde-bfbb-386e04865b24' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:43 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:43 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/5c792e49-68de-445f-a152-e2d54e086165-m0.avro' Request method: 'PUT' Request headers: 'Content-Length': '5823' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '6350deba-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:43 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/5c792e49-68de-445f-a152-e2d54e086165-m0.avro HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:43 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x21C29ABCBB735A0"' 'last-modified': 'Fri, 23 May 2025 21:10:43 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '6350deba-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '4e21906d-c2fb-4653-a8d5-e0d900e1ab6d' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:43 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:43 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/v2.metadata.json' Request method: 'PUT' Request headers: 'Content-Length': '3230' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '6352d0b2-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:43 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/v2.metadata.json HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:43 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x1F1976600936E00"' 'last-modified': 'Fri, 23 May 2025 21:10:43 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '6352d0b2-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': 'ff1897c8-9cfa-4e67-8639-22a002ddb567' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:43 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:43 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/snap-7991125359598869457-1-5c792e49-68de-445f-a152-e2d54e086165.avro' Request method: 'PUT' Request headers: 'Content-Length': '3794' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '63546b02-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:43 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/snap-7991125359598869457-1-5c792e49-68de-445f-a152-e2d54e086165.avro HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:43 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x25D53BD26C112C0"' 'last-modified': 'Fri, 23 May 2025 21:10:43 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '63546b02-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '82c7441c-9815-48f6-9775-9a8c46ac3e73' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:43 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:43 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/snap-5564646408240486829-1-15d72da5-03eb-41d3-8b85-bcfc291c0c35.avro' Request method: 'PUT' Request headers: 'Content-Length': '3903' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '6355b610-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:43 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/snap-5564646408240486829-1-15d72da5-03eb-41d3-8b85-bcfc291c0c35.avro HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:43 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x2532F8CA1F64460"' 'last-modified': 'Fri, 23 May 2025 21:10:43 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '6355b610-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '53763f82-b8e5-4990-bd15-f6898fe259b2' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:43 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:43 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/15d72da5-03eb-41d3-8b85-bcfc291c0c35-m0.avro' Request method: 'PUT' Request headers: 'Content-Length': '5823' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '63571348-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:43 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/15d72da5-03eb-41d3-8b85-bcfc291c0c35-m0.avro HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:43 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x26A7639C1FD7F20"' 'last-modified': 'Fri, 23 May 2025 21:10:43 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '63571348-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '61bff320-959e-4746-96ad-dbeaef9d656d' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:43 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:43 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/aca152b8-867e-4de5-a280-d0e6a7d40120-m0.avro' Request method: 'PUT' Request headers: 'Content-Length': '5821' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '6358a35c-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:43 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/aca152b8-867e-4de5-a280-d0e6a7d40120-m0.avro HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:43 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x1E5A163A59A8790"' 'last-modified': 'Fri, 23 May 2025 21:10:43 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '6358a35c-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '4a6776e3-15bd-43ea-b51b-d694f9a8ea8c' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:43 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:43 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/snap-3999306977933642072-1-aca152b8-867e-4de5-a280-d0e6a7d40120.avro' Request method: 'PUT' Request headers: 'Content-Length': '3863' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '6359db64-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:43 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/snap-3999306977933642072-1-aca152b8-867e-4de5-a280-d0e6a7d40120.avro HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:43 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x1FC1E2846A65700"' 'last-modified': 'Fri, 23 May 2025 21:10:43 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '6359db64-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': 'ef7fa404-f8ef-46b0-b0eb-919232b81566' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:43 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:43 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/version-hint.text' Request method: 'PUT' Request headers: 'Content-Length': '1' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '635afb02-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:43 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/version-hint.text HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:43 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x211AADC811CCCA0"' 'last-modified': 'Fri, 23 May 2025 21:10:43 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '635afb02-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': 'addb801f-ac1b-41d1-9f35-693abd10ad61' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:43 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:43 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/v1.metadata.json' Request method: 'PUT' Request headers: 'Content-Length': '2180' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '635c2428-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:43 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/v1.metadata.json HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:43 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x1ECCF3B0F32C120"' 'last-modified': 'Fri, 23 May 2025 21:10:43 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '635c2428-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '070483b4-c712-4388-a70b-fbf5be8ebb24' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:43 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:43 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/v3.metadata.json' Request method: 'PUT' Request headers: 'Content-Length': '4281' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '635d4d1c-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:43 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/v3.metadata.json HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:43 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x210963B31F9A500"' 'last-modified': 'Fri, 23 May 2025 21:10:43 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '635d4d1c-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '23d3e9d6-b676-41f4-82aa-45d70ea1cc69' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:43 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:43 [ 671 ] INFO : Adding another dataframe. result files: ['/iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/data/00000-5-10122230-5d9c-476b-a009-a874758d5f10-00001.parquet', '/iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/data/00000-3-803ee0fd-ab0b-4650-b3a0-920758eaf40b-00001.parquet', '/iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/data/00000-1-338c07cd-61f1-424d-90d9-03bc38788e5e-00001.parquet', '/iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/5c792e49-68de-445f-a152-e2d54e086165-m0.avro', '/iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/v2.metadata.json', '/iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/snap-7991125359598869457-1-5c792e49-68de-445f-a152-e2d54e086165.avro', '/iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/snap-5564646408240486829-1-15d72da5-03eb-41d3-8b85-bcfc291c0c35.avro', '/iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/15d72da5-03eb-41d3-8b85-bcfc291c0c35-m0.avro', '/iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/aca152b8-867e-4de5-a280-d0e6a7d40120-m0.avro', '/iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/snap-3999306977933642072-1-aca152b8-867e-4de5-a280-d0e6a7d40120.avro', '/iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/version-hint.text', '/iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/v1.metadata.json', '/iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/v3.metadata.json'] (test.py:666, add_df) 2025-05-23 21:10:43 [ 671 ] INFO : Setup complete. files: ['/iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/data/00000-5-10122230-5d9c-476b-a009-a874758d5f10-00001.parquet', '/iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/data/00000-3-803ee0fd-ab0b-4650-b3a0-920758eaf40b-00001.parquet', '/iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/data/00000-1-338c07cd-61f1-424d-90d9-03bc38788e5e-00001.parquet', '/iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/5c792e49-68de-445f-a152-e2d54e086165-m0.avro', '/iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/v2.metadata.json', '/iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/snap-7991125359598869457-1-5c792e49-68de-445f-a152-e2d54e086165.avro', '/iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/snap-5564646408240486829-1-15d72da5-03eb-41d3-8b85-bcfc291c0c35.avro', '/iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/15d72da5-03eb-41d3-8b85-bcfc291c0c35-m0.avro', '/iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/aca152b8-867e-4de5-a280-d0e6a7d40120-m0.avro', '/iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/snap-3999306977933642072-1-aca152b8-867e-4de5-a280-d0e6a7d40120.avro', '/iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/version-hint.text', '/iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/v1.metadata.json', '/iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/metadata/v3.metadata.json'] (test.py:674, test_cluster_table_function) 2025-05-23 21:10:43 [ 671 ] DEBUG : Executing query SELECT * FROM system.clusters on node1 (cluster.py:3570, query) 2025-05-23 21:10:43 [ 671 ] INFO : Clusters setup: cluster_simple 1 1 0 1 node1 172.16.1.9 9000 1 default 0 0 0 \N \N \N cluster_simple 1 1 0 2 node2 172.16.1.7 9000 0 default 0 0 0 \N \N \N cluster_simple 1 1 0 3 node3 172.16.1.8 9000 0 default 0 0 0 \N \N \N (test.py:678, test_cluster_table_function) 2025-05-23 21:10:43 [ 671 ] DEBUG : Executing query SELECT * FROM icebergAzure(azure, container = 'mycontainer', storage_account_url = 'http://azurite1:30050/devstoreaccount1', blob_path = '/iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/', format=Parquet) on node1 (cluster.py:3570, query) 2025-05-23 21:10:43 [ 671 ] DEBUG : Executing query SELECT * FROM icebergAzureCluster('cluster_simple', azure, container = 'mycontainer', storage_account_url = 'http://azurite1:30050/devstoreaccount1', blob_path = '/iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/', format=Parquet) on node1 (cluster.py:3570, query) 2025-05-23 21:10:44 [ 671 ] DEBUG : Executing query SELECT * FROM icebergAzureCluster('cluster_simple', azure, container = 'mycontainer', storage_account_url = 'http://azurite1:30050/devstoreaccount1', blob_path = '/iceberg_data/default/test_iceberg_cluster_1_azure_47c00bfa_b3cf_4f1d_a8df_7fea01da658b/', format=Parquet) SETTINGS object_storage_cluster='cluster_simple' on node1 (cluster.py:3570, query) _____________________ test_cluster_table_function[azure-2] _____________________ [gw1] linux -- Python 3.10.12 /usr/bin/python3 started_cluster = format_version = '2', storage_type = 'azure' @pytest.mark.parametrize("format_version", ["1", "2"]) @pytest.mark.parametrize("storage_type", ["s3", "azure"]) def test_cluster_table_function(started_cluster, format_version, storage_type): instance = started_cluster.instances["node1"] spark = started_cluster.spark_session TABLE_NAME = ( "test_iceberg_cluster_" + format_version + "_" + storage_type + "_" + get_uuid_str() ) def add_df(mode): write_iceberg_from_df( spark, generate_data(spark, 0, 100), TABLE_NAME, mode=mode, format_version=format_version, ) files = default_upload_directory( started_cluster, storage_type, f"/iceberg_data/default/{TABLE_NAME}/", f"/iceberg_data/default/{TABLE_NAME}/", ) logging.info(f"Adding another dataframe. result files: {files}") return files files = add_df(mode="overwrite") for i in range(1, len(started_cluster.instances)): files = add_df(mode="append") logging.info(f"Setup complete. files: {files}") assert len(files) == 5 + 4 * (len(started_cluster.instances) - 1) clusters = instance.query(f"SELECT * FROM system.clusters") logging.info(f"Clusters setup: {clusters}") # Regular Query only node1 table_function_expr = get_creation_expression( storage_type, TABLE_NAME, started_cluster, table_function=True ) select_regular = ( instance.query(f"SELECT * FROM {table_function_expr}").strip().split() ) def make_query_from_function( run_on_cluster=False, alt_syntax=False, remote=False, storage_type_as_arg=False, storage_type_in_named_collection=False, ): expr = get_creation_expression( storage_type, TABLE_NAME, started_cluster, table_function=True, run_on_cluster=run_on_cluster, storage_type_as_arg=storage_type_as_arg, storage_type_in_named_collection=storage_type_in_named_collection, ) query_id = str(uuid.uuid4()) settings = "SETTINGS object_storage_cluster='cluster_simple'" if alt_syntax else "" if remote: query = f"SELECT * FROM remote('node2', {expr}) {settings}" else: query = f"SELECT * FROM {expr} {settings}" responce = instance.query(query, query_id=query_id).strip().split() return responce, query_id # Cluster Query with node1 as coordinator select_cluster, query_id_cluster = make_query_from_function(run_on_cluster=True) # Cluster Query with node1 as coordinator with alternative syntax > select_cluster_alt_syntax, query_id_cluster_alt_syntax = make_query_from_function( run_on_cluster=True, alt_syntax=True) test_storage_iceberg/test.py:717: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ test_storage_iceberg/test.py:710: in make_query_from_function responce = instance.query(query, query_id=query_id).strip().split() helpers/cluster.py:3571: in query return self.client.query( helpers/client.py:39: in wrap return func(self, *args, **kwargs) helpers/client.py:79: in query ).get_answer() _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = def get_answer(self): self.process.wait(timeout=DEFAULT_QUERY_TIMEOUT) self.stdout_file.seek(0) self.stderr_file.seek(0) stdout = self.stdout_file.read().decode("utf-8", errors="replace") stderr = self.stderr_file.read().decode("utf-8", errors="replace") if ( self.timer is not None and not self.process_finished_before_timeout and not self.ignore_error ): logging.debug(f"Timed out. Last stdout:{stdout}, stderr:{stderr}") raise QueryTimeoutExceedException("Client timed out!") if ( self.process.returncode != 0 or self.remove_trash_from_stderr(stderr) ) and not self.ignore_error: > raise QueryRuntimeException( "Client failed! Return code: {}, stderr: {}".format( self.process.returncode, stderr ), self.process.returncode, stderr, ) E helpers.client.QueryRuntimeException: Client failed! Return code: 115, stderr: Received exception from server (version 25.3.3): E Code: 115. DB::Exception: Received from 172.16.1.9:9000. DB::Exception: Setting object_storage_cluster is neither a builtin setting nor started with the prefix 'custom_' registered for user-defined settings. Stack trace: E E 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000f4b58fb E 1. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x0000000009f80e6c E 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x0000000009f8082b E 3. DB::AccessControl::CustomSettingsPrefixes::checkSettingNameIsAllowed(std::basic_string_view>) const @ 0x000000001232e9f8 E 4. DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000012449944 E 5. DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges&, DB::SettingSource) const @ 0x0000000012449cc3 E 6. DB::Context::checkSettingsConstraintsWithLock(DB::SettingsChanges&, DB::SettingSource) @ 0x00000000130c30b4 E 7. DB::TCPHandler::processQuery(std::optional&) @ 0x0000000014cb4303 E 8. DB::TCPHandler::receivePacketsExpectQuery(std::optional&) @ 0x0000000014ca97f4 E 9. DB::TCPHandler::runImpl() @ 0x0000000014c9cdb9 E 10. DB::TCPHandler::run() @ 0x0000000014cbbaf9 E 11. Poco::Net::TCPServerConnection::start() @ 0x00000000183ecfc7 E 12. Poco::Net::TCPServerDispatcher::run() @ 0x00000000183ed419 E 13. Poco::PooledThread::run() @ 0x00000000183b975b E 14. Poco::ThreadImpl::runnableEntry(void*) @ 0x00000000183b7c3d E 15. ? @ 0x00007f28fa6ebac3 E 16. ? @ 0x00007f28fa77d850 E . (UNKNOWN_SETTING) E (query: SELECT * FROM E icebergAzureCluster('cluster_simple', azure, container = 'mycontainer', storage_account_url = 'http://azurite1:30050/devstoreaccount1', blob_path = '/iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/', format=Parquet) E SETTINGS object_storage_cluster='cluster_simple') helpers/client.py:248: QueryRuntimeException ----------------------------- Captured stdout call ----------------------------- 25/05/23 21:10:44 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:44 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:44 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:44 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:44 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:44 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. {} {} {} 25/05/23 21:10:44 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:44 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:44 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:44 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:44 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:44 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. {} {} {} 25/05/23 21:10:45 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:45 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:45 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:45 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:45 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:45 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. {} {} {} ------------------------------ Captured log call ------------------------------- 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro178 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o178 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o61 range i0 i100 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro179 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ylo180 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o180 add sa e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro180 e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro181 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o179 toDF ro181 e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro182 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro183 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o183 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o61 range i1 i101 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro184 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ylo185 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o185 add sb e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro185 e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro186 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o184 toDF ro186 e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro187 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o187 apply sb e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro188 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro189 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o189 isDefined e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro190 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o190 get e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro191 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro192 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yao193 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o192 applyModifiableSettings ro191 ro193 e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o61 parseDataType s"string" e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro194 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o188 cast ro194 e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro195 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o187 withColumn sb ro195 e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro196 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro197 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro198 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ylo199 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o199 add ro198 e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro199 e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro200 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro200 e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro201 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o197 over ro201 e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro202 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o182 withColumn srow_index ro202 e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro203 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro204 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro205 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ylo206 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o206 add ro205 e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro206 e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro207 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro207 e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro208 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o204 over ro208 e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro209 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o196 withColumn srow_index ro209 e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro210 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ylo211 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o211 add srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro211 e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro212 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o203 join ro210 ro212 sinner e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro213 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o213 drop srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro214 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o214 writeTo stest_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957 e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro215 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o215 tableProperty sformat-version s2 e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro216 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o215 using siceberg e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro217 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o215 create e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/data/00000-7-687a3056-eaf2-482f-aaea-7165d55254ea-00001.parquet' Request method: 'PUT' Request headers: 'Content-Length': '967' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '640e2ef2-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:44 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/data/00000-7-687a3056-eaf2-482f-aaea-7165d55254ea-00001.parquet HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:44 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x2276C07A03C8A20"' 'last-modified': 'Fri, 23 May 2025 21:10:44 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '640e2ef2-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '914984be-be7b-48c7-a5ca-9ea78dce8f50' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:44 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:44 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/snap-3935654101549983307-1-486cfc54-c87e-4518-85e8-d84c96ce4972.avro' Request method: 'PUT' Request headers: 'Content-Length': '4290' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '640fb5f6-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:44 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/snap-3935654101549983307-1-486cfc54-c87e-4518-85e8-d84c96ce4972.avro HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:44 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x2091421042FF8E0"' 'last-modified': 'Fri, 23 May 2025 21:10:44 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '640fb5f6-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '920cd491-9f1d-4c43-998d-5a417bc4abb3' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:44 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:44 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/486cfc54-c87e-4518-85e8-d84c96ce4972-m0.avro' Request method: 'PUT' Request headers: 'Content-Length': '6708' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '6410de7c-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:44 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/486cfc54-c87e-4518-85e8-d84c96ce4972-m0.avro HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:44 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x1CFCB8D9F49A660"' 'last-modified': 'Fri, 23 May 2025 21:10:44 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '6410de7c-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '8aa34bf4-1ec9-442c-a767-3abf6a125c7e' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:44 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:44 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/version-hint.text' Request method: 'PUT' Request headers: 'Content-Length': '1' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '64122c14-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:44 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/version-hint.text HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:44 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x246C71296DDA760"' 'last-modified': 'Fri, 23 May 2025 21:10:44 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '64122c14-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': 'a6a778c4-c55f-4b5f-b6c4-21f112a077bd' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:44 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:44 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/v1.metadata.json' Request method: 'PUT' Request headers: 'Content-Length': '1941' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '64132c86-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:44 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/v1.metadata.json HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:44 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x269EA5222B341C0"' 'last-modified': 'Fri, 23 May 2025 21:10:44 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '64132c86-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '987908b8-b4a1-4396-a3fc-df0ac71ae7ce' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:44 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:44 [ 671 ] INFO : Adding another dataframe. result files: ['/iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/data/00000-7-687a3056-eaf2-482f-aaea-7165d55254ea-00001.parquet', '/iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/snap-3935654101549983307-1-486cfc54-c87e-4518-85e8-d84c96ce4972.avro', '/iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/486cfc54-c87e-4518-85e8-d84c96ce4972-m0.avro', '/iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/version-hint.text', '/iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/v1.metadata.json'] (test.py:666, add_df) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro218 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o218 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o61 range i0 i100 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro219 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ylo220 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o220 add sa e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro220 e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro221 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o219 toDF ro221 e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro222 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro223 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o223 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o61 range i1 i101 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro224 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ylo225 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o225 add sb e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro225 e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro226 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o224 toDF ro226 e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro227 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o227 apply sb e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro228 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro229 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o229 isDefined e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro230 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o230 get e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro231 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro232 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yao233 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o232 applyModifiableSettings ro231 ro233 e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o61 parseDataType s"string" e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro234 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o228 cast ro234 e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro235 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o227 withColumn sb ro235 e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro236 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro237 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro238 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ylo239 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o239 add ro238 e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro239 e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro240 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro240 e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro241 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o237 over ro241 e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro242 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o222 withColumn srow_index ro242 e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro243 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro244 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro245 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ylo246 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o246 add ro245 e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro246 e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro247 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro247 e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro248 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o244 over ro248 e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro249 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o236 withColumn srow_index ro249 e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro250 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ylo251 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o251 add srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro251 e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro252 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o243 join ro250 ro252 sinner e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro253 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o253 drop srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro254 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o254 writeTo stest_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957 e (clientserver.py:501, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Answer received: !yro255 (clientserver.py:512, send_command) 2025-05-23 21:10:44 [ 671 ] DEBUG : Command to send: c o255 append e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/data/00000-9-f5d0140e-5469-45bc-86da-dcfdf5c67bff-00001.parquet' Request method: 'PUT' Request headers: 'Content-Length': '967' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '6444a522-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:45 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/data/00000-9-f5d0140e-5469-45bc-86da-dcfdf5c67bff-00001.parquet HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:45 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x23F23957A4F0940"' 'last-modified': 'Fri, 23 May 2025 21:10:45 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '6444a522-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '50721d1d-7adf-4740-a9a0-260502cf1c47' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:45 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:45 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/data/00000-7-687a3056-eaf2-482f-aaea-7165d55254ea-00001.parquet' Request method: 'PUT' Request headers: 'Content-Length': '967' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '6447011e-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:45 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/data/00000-7-687a3056-eaf2-482f-aaea-7165d55254ea-00001.parquet HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:45 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x1EBD409B6FF7E00"' 'last-modified': 'Fri, 23 May 2025 21:10:45 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '6447011e-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': 'ddac1cc9-8ecc-4793-9d2e-e6bca3b739fa' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:45 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:45 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/snap-3935654101549983307-1-486cfc54-c87e-4518-85e8-d84c96ce4972.avro' Request method: 'PUT' Request headers: 'Content-Length': '4290' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '64489650-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:45 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/snap-3935654101549983307-1-486cfc54-c87e-4518-85e8-d84c96ce4972.avro HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:45 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x234F2ACFD932320"' 'last-modified': 'Fri, 23 May 2025 21:10:45 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '64489650-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '2f8ec21c-01b8-47f8-b180-654ad211f257' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:45 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:45 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/v2.metadata.json' Request method: 'PUT' Request headers: 'Content-Length': '3018' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '6449d876-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o17 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o16 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o14 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o25 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o180 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o185 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o193 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o199 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o206 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o211 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o178 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o179 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o181 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o182 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o183 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/v2.metadata.json HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:45 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x2542F8307886700"' 'last-modified': 'Fri, 23 May 2025 21:10:45 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '6449d876-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': 'a4be59f7-30ec-4898-bcd7-0e99b4e29f03' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:45 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:45 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/486cfc54-c87e-4518-85e8-d84c96ce4972-m0.avro' Request method: 'PUT' Request headers: 'Content-Length': '6708' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '644b0386-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o184 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o186 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o187 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o188 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o189 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o190 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o192 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o194 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o195 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o196 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o197 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o198 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o200 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o201 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o202 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o203 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o204 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o205 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o207 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o208 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/486cfc54-c87e-4518-85e8-d84c96ce4972-m0.avro HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:45 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x211F0D05C6893C0"' 'last-modified': 'Fri, 23 May 2025 21:10:45 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '644b0386-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': 'c4e82c43-0fa4-4d21-8b5d-d612fc8399ef' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:45 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:45 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/version-hint.text' Request method: 'PUT' Request headers: 'Content-Length': '1' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '644c2e0a-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o209 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o210 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o212 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o213 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o216 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o217 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o220 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o225 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o233 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o239 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o246 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o215 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o218 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o219 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o221 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o222 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o223 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o224 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o226 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o227 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o228 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o229 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/version-hint.text HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:45 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x1EEE23BC3522440"' 'last-modified': 'Fri, 23 May 2025 21:10:45 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '644c2e0a-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '8e28a8d8-71a8-44d3-9110-20d8ca5bc4ce' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:45 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o230 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/65c10e99-2007-4f24-8d4f-4c5b462c7814-m0.avro' Request method: 'PUT' Request headers: 'Content-Length': '6710' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '644d3d7c-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o232 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o234 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o235 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o236 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o237 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o238 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o240 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o241 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o242 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o244 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o245 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o247 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o248 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o249 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: m d o251 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/65c10e99-2007-4f24-8d4f-4c5b462c7814-m0.avro HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:45 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x1EED583CB7A0AC0"' 'last-modified': 'Fri, 23 May 2025 21:10:45 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '644d3d7c-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '0d99b4d8-f524-4598-99d3-918553df435d' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:45 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:45 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/v1.metadata.json' Request method: 'PUT' Request headers: 'Content-Length': '1941' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '644e4988-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/v1.metadata.json HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:45 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x1EA914D85726690"' 'last-modified': 'Fri, 23 May 2025 21:10:45 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '644e4988-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': 'c5a90946-a11d-4267-a5f9-f5f65796ed2e' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:45 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:45 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/snap-3297224066871078931-1-65c10e99-2007-4f24-8d4f-4c5b462c7814.avro' Request method: 'PUT' Request headers: 'Content-Length': '4362' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '644f49fa-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:45 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/snap-3297224066871078931-1-65c10e99-2007-4f24-8d4f-4c5b462c7814.avro HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:45 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x1E2B2FD8CA652B0"' 'last-modified': 'Fri, 23 May 2025 21:10:45 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '644f49fa-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '2757e0c0-70dd-49fc-9b8b-9a85dca79516' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:45 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:45 [ 671 ] INFO : Adding another dataframe. result files: ['/iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/data/00000-9-f5d0140e-5469-45bc-86da-dcfdf5c67bff-00001.parquet', '/iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/data/00000-7-687a3056-eaf2-482f-aaea-7165d55254ea-00001.parquet', '/iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/snap-3935654101549983307-1-486cfc54-c87e-4518-85e8-d84c96ce4972.avro', '/iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/v2.metadata.json', '/iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/486cfc54-c87e-4518-85e8-d84c96ce4972-m0.avro', '/iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/version-hint.text', '/iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/65c10e99-2007-4f24-8d4f-4c5b462c7814-m0.avro', '/iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/v1.metadata.json', '/iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/snap-3297224066871078931-1-65c10e99-2007-4f24-8d4f-4c5b462c7814.avro'] (test.py:666, add_df) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yro256 (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: c o256 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: c o61 range i0 i100 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yro257 (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !ylo258 (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: c o258 add sa e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro258 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yro259 (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: c o257 toDF ro259 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yro260 (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yro261 (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: c o261 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: c o61 range i1 i101 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yro262 (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !ylo263 (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: c o263 add sb e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro263 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yro264 (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: c o262 toDF ro264 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yro265 (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: c o265 apply sb e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yro266 (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yro267 (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: c o267 isDefined e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yro268 (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: c o268 get e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yro269 (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yro270 (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yao271 (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: c o270 applyModifiableSettings ro269 ro271 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: c o61 parseDataType s"string" e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yro272 (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: c o266 cast ro272 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yro273 (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: c o265 withColumn sb ro273 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yro274 (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yro275 (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yro276 (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !ylo277 (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: c o277 add ro276 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro277 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yro278 (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro278 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yro279 (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: c o275 over ro279 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yro280 (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: c o260 withColumn srow_index ro280 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yro281 (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yro282 (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yro283 (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !ylo284 (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: c o284 add ro283 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro284 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yro285 (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro285 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yro286 (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: c o282 over ro286 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yro287 (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: c o274 withColumn srow_index ro287 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yro288 (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !ylo289 (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: c o289 add srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro289 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yro290 (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: c o281 join ro288 ro290 sinner e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yro291 (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: c o291 drop srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yro292 (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: c o292 writeTo stest_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957 e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yro293 (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Command to send: c o293 append e (clientserver.py:501, send_command) 2025-05-23 21:10:45 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:45 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/data/00000-9-f5d0140e-5469-45bc-86da-dcfdf5c67bff-00001.parquet' Request method: 'PUT' Request headers: 'Content-Length': '967' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '6480bad0-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:45 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/data/00000-9-f5d0140e-5469-45bc-86da-dcfdf5c67bff-00001.parquet HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:45 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x1BE2D35E4A9D220"' 'last-modified': 'Fri, 23 May 2025 21:10:45 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '6480bad0-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '78fd5b18-39b7-4157-93d8-a79b5067e46a' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:45 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:45 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/data/00000-11-916d64a3-b44a-43f1-8fac-ab1aa250ef31-00001.parquet' Request method: 'PUT' Request headers: 'Content-Length': '967' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '64824a94-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:45 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/data/00000-11-916d64a3-b44a-43f1-8fac-ab1aa250ef31-00001.parquet HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:45 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x1D3FFDDF2D5EB80"' 'last-modified': 'Fri, 23 May 2025 21:10:45 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '64824a94-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': 'fc7b4005-8788-4d44-9ac0-1dbe90da0b2e' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:45 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:45 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/data/00000-7-687a3056-eaf2-482f-aaea-7165d55254ea-00001.parquet' Request method: 'PUT' Request headers: 'Content-Length': '967' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '6483a6aa-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:45 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/data/00000-7-687a3056-eaf2-482f-aaea-7165d55254ea-00001.parquet HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:45 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x1BF469C30EE3D60"' 'last-modified': 'Fri, 23 May 2025 21:10:45 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '6483a6aa-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '16ffe109-00dd-4ed4-8919-ded435f3d008' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:45 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:45 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/snap-3935654101549983307-1-486cfc54-c87e-4518-85e8-d84c96ce4972.avro' Request method: 'PUT' Request headers: 'Content-Length': '4290' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '6484f51e-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:45 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/snap-3935654101549983307-1-486cfc54-c87e-4518-85e8-d84c96ce4972.avro HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:45 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x26831F040873F40"' 'last-modified': 'Fri, 23 May 2025 21:10:45 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '6484f51e-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '02430ef7-5c03-409a-8a47-6e4d96196394' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:45 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:45 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/v2.metadata.json' Request method: 'PUT' Request headers: 'Content-Length': '3018' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '64862858-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:45 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/v2.metadata.json HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:45 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x1D9BB4749462D50"' 'last-modified': 'Fri, 23 May 2025 21:10:45 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '64862858-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': 'b937b60e-c5ed-42b9-bd86-ef035c9616d7' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:45 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:45 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/486cfc54-c87e-4518-85e8-d84c96ce4972-m0.avro' Request method: 'PUT' Request headers: 'Content-Length': '6708' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '64877a00-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:45 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/486cfc54-c87e-4518-85e8-d84c96ce4972-m0.avro HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:45 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x1C3CA6A4E7B04B0"' 'last-modified': 'Fri, 23 May 2025 21:10:45 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '64877a00-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': 'af7d3b2a-9ec5-4f6b-8e00-1df9f0614c18' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:45 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:45 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/snap-6018727262868955929-1-3a4b7be4-4cb3-4f77-b58c-de0f7c229d48.avro' Request method: 'PUT' Request headers: 'Content-Length': '4409' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '64889eda-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:45 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/snap-6018727262868955929-1-3a4b7be4-4cb3-4f77-b58c-de0f7c229d48.avro HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:45 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x22CEC9E206417C0"' 'last-modified': 'Fri, 23 May 2025 21:10:45 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '64889eda-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': 'b2e9d085-50b3-4e02-a8d7-23a0ba439991' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:45 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:45 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/3a4b7be4-4cb3-4f77-b58c-de0f7c229d48-m0.avro' Request method: 'PUT' Request headers: 'Content-Length': '6714' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '6489bb44-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:45 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/3a4b7be4-4cb3-4f77-b58c-de0f7c229d48-m0.avro HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:45 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x1D241201084A640"' 'last-modified': 'Fri, 23 May 2025 21:10:45 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '6489bb44-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': 'b3820104-8e90-4168-9ecc-29f6cbb4eee9' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:45 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:45 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/version-hint.text' Request method: 'PUT' Request headers: 'Content-Length': '1' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '648abc9c-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:45 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/version-hint.text HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:45 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x24920071B469C80"' 'last-modified': 'Fri, 23 May 2025 21:10:45 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '648abc9c-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '2159d914-9e63-4334-a293-a4077aa5a297' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:45 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:45 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/65c10e99-2007-4f24-8d4f-4c5b462c7814-m0.avro' Request method: 'PUT' Request headers: 'Content-Length': '6710' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '648bc7b8-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:45 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/65c10e99-2007-4f24-8d4f-4c5b462c7814-m0.avro HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:45 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x20D637847377880"' 'last-modified': 'Fri, 23 May 2025 21:10:45 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '648bc7b8-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': 'd98a8fa9-0224-4a76-a283-2837d421a9ec' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:45 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:45 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/v1.metadata.json' Request method: 'PUT' Request headers: 'Content-Length': '1941' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '648cff7a-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:45 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/v1.metadata.json HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:45 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x229EFE909310D80"' 'last-modified': 'Fri, 23 May 2025 21:10:45 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '648cff7a-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '00abefc6-7d81-4650-9ae3-143de924d71f' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:45 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:45 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/snap-3297224066871078931-1-65c10e99-2007-4f24-8d4f-4c5b462c7814.avro' Request method: 'PUT' Request headers: 'Content-Length': '4362' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '648eb72a-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:45 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/snap-3297224066871078931-1-65c10e99-2007-4f24-8d4f-4c5b462c7814.avro HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:45 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x1E3585524EDB600"' 'last-modified': 'Fri, 23 May 2025 21:10:45 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '648eb72a-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '032aba95-354f-4a01-a920-13138b540dd4' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:45 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:45 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/v3.metadata.json' Request method: 'PUT' Request headers: 'Content-Length': '4096' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '64903d8e-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:45 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/v3.metadata.json HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:45 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x26AB43AA68B76A0"' 'last-modified': 'Fri, 23 May 2025 21:10:45 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '64903d8e-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '9dbfbdd1-bd5a-4068-9c6e-9718d5b2726b' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:45 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:45 [ 671 ] INFO : Adding another dataframe. result files: ['/iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/data/00000-9-f5d0140e-5469-45bc-86da-dcfdf5c67bff-00001.parquet', '/iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/data/00000-11-916d64a3-b44a-43f1-8fac-ab1aa250ef31-00001.parquet', '/iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/data/00000-7-687a3056-eaf2-482f-aaea-7165d55254ea-00001.parquet', '/iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/snap-3935654101549983307-1-486cfc54-c87e-4518-85e8-d84c96ce4972.avro', '/iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/v2.metadata.json', '/iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/486cfc54-c87e-4518-85e8-d84c96ce4972-m0.avro', '/iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/snap-6018727262868955929-1-3a4b7be4-4cb3-4f77-b58c-de0f7c229d48.avro', '/iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/3a4b7be4-4cb3-4f77-b58c-de0f7c229d48-m0.avro', '/iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/version-hint.text', '/iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/65c10e99-2007-4f24-8d4f-4c5b462c7814-m0.avro', '/iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/v1.metadata.json', '/iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/snap-3297224066871078931-1-65c10e99-2007-4f24-8d4f-4c5b462c7814.avro', '/iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/v3.metadata.json'] (test.py:666, add_df) 2025-05-23 21:10:45 [ 671 ] INFO : Setup complete. files: ['/iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/data/00000-9-f5d0140e-5469-45bc-86da-dcfdf5c67bff-00001.parquet', '/iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/data/00000-11-916d64a3-b44a-43f1-8fac-ab1aa250ef31-00001.parquet', '/iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/data/00000-7-687a3056-eaf2-482f-aaea-7165d55254ea-00001.parquet', '/iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/snap-3935654101549983307-1-486cfc54-c87e-4518-85e8-d84c96ce4972.avro', '/iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/v2.metadata.json', '/iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/486cfc54-c87e-4518-85e8-d84c96ce4972-m0.avro', '/iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/snap-6018727262868955929-1-3a4b7be4-4cb3-4f77-b58c-de0f7c229d48.avro', '/iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/3a4b7be4-4cb3-4f77-b58c-de0f7c229d48-m0.avro', '/iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/version-hint.text', '/iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/65c10e99-2007-4f24-8d4f-4c5b462c7814-m0.avro', '/iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/v1.metadata.json', '/iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/snap-3297224066871078931-1-65c10e99-2007-4f24-8d4f-4c5b462c7814.avro', '/iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/metadata/v3.metadata.json'] (test.py:674, test_cluster_table_function) 2025-05-23 21:10:45 [ 671 ] DEBUG : Executing query SELECT * FROM system.clusters on node1 (cluster.py:3570, query) 2025-05-23 21:10:45 [ 671 ] INFO : Clusters setup: cluster_simple 1 1 0 1 node1 172.16.1.9 9000 1 default 0 0 0 \N \N \N cluster_simple 1 1 0 2 node2 172.16.1.7 9000 0 default 0 0 0 \N \N \N cluster_simple 1 1 0 3 node3 172.16.1.8 9000 0 default 0 0 0 \N \N \N (test.py:678, test_cluster_table_function) 2025-05-23 21:10:45 [ 671 ] DEBUG : Executing query SELECT * FROM icebergAzure(azure, container = 'mycontainer', storage_account_url = 'http://azurite1:30050/devstoreaccount1', blob_path = '/iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/', format=Parquet) on node1 (cluster.py:3570, query) 2025-05-23 21:10:45 [ 671 ] DEBUG : Executing query SELECT * FROM icebergAzureCluster('cluster_simple', azure, container = 'mycontainer', storage_account_url = 'http://azurite1:30050/devstoreaccount1', blob_path = '/iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/', format=Parquet) on node1 (cluster.py:3570, query) 2025-05-23 21:10:45 [ 671 ] DEBUG : Executing query SELECT * FROM icebergAzureCluster('cluster_simple', azure, container = 'mycontainer', storage_account_url = 'http://azurite1:30050/devstoreaccount1', blob_path = '/iceberg_data/default/test_iceberg_cluster_2_azure_0ec68ad3_27a9_4ea4_b5ce_2b050578d957/', format=Parquet) SETTINGS object_storage_cluster='cluster_simple' on node1 (cluster.py:3570, query) ---------------------------- Captured log teardown ----------------------------- 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: m d o255 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) ______________________ test_cluster_table_function[s3-1] _______________________ [gw1] linux -- Python 3.10.12 /usr/bin/python3 started_cluster = format_version = '1', storage_type = 's3' @pytest.mark.parametrize("format_version", ["1", "2"]) @pytest.mark.parametrize("storage_type", ["s3", "azure"]) def test_cluster_table_function(started_cluster, format_version, storage_type): instance = started_cluster.instances["node1"] spark = started_cluster.spark_session TABLE_NAME = ( "test_iceberg_cluster_" + format_version + "_" + storage_type + "_" + get_uuid_str() ) def add_df(mode): write_iceberg_from_df( spark, generate_data(spark, 0, 100), TABLE_NAME, mode=mode, format_version=format_version, ) files = default_upload_directory( started_cluster, storage_type, f"/iceberg_data/default/{TABLE_NAME}/", f"/iceberg_data/default/{TABLE_NAME}/", ) logging.info(f"Adding another dataframe. result files: {files}") return files files = add_df(mode="overwrite") for i in range(1, len(started_cluster.instances)): files = add_df(mode="append") logging.info(f"Setup complete. files: {files}") assert len(files) == 5 + 4 * (len(started_cluster.instances) - 1) clusters = instance.query(f"SELECT * FROM system.clusters") logging.info(f"Clusters setup: {clusters}") # Regular Query only node1 table_function_expr = get_creation_expression( storage_type, TABLE_NAME, started_cluster, table_function=True ) select_regular = ( instance.query(f"SELECT * FROM {table_function_expr}").strip().split() ) def make_query_from_function( run_on_cluster=False, alt_syntax=False, remote=False, storage_type_as_arg=False, storage_type_in_named_collection=False, ): expr = get_creation_expression( storage_type, TABLE_NAME, started_cluster, table_function=True, run_on_cluster=run_on_cluster, storage_type_as_arg=storage_type_as_arg, storage_type_in_named_collection=storage_type_in_named_collection, ) query_id = str(uuid.uuid4()) settings = "SETTINGS object_storage_cluster='cluster_simple'" if alt_syntax else "" if remote: query = f"SELECT * FROM remote('node2', {expr}) {settings}" else: query = f"SELECT * FROM {expr} {settings}" responce = instance.query(query, query_id=query_id).strip().split() return responce, query_id # Cluster Query with node1 as coordinator select_cluster, query_id_cluster = make_query_from_function(run_on_cluster=True) # Cluster Query with node1 as coordinator with alternative syntax > select_cluster_alt_syntax, query_id_cluster_alt_syntax = make_query_from_function( run_on_cluster=True, alt_syntax=True) test_storage_iceberg/test.py:717: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ test_storage_iceberg/test.py:710: in make_query_from_function responce = instance.query(query, query_id=query_id).strip().split() helpers/cluster.py:3571: in query return self.client.query( helpers/client.py:39: in wrap return func(self, *args, **kwargs) helpers/client.py:79: in query ).get_answer() _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = def get_answer(self): self.process.wait(timeout=DEFAULT_QUERY_TIMEOUT) self.stdout_file.seek(0) self.stderr_file.seek(0) stdout = self.stdout_file.read().decode("utf-8", errors="replace") stderr = self.stderr_file.read().decode("utf-8", errors="replace") if ( self.timer is not None and not self.process_finished_before_timeout and not self.ignore_error ): logging.debug(f"Timed out. Last stdout:{stdout}, stderr:{stderr}") raise QueryTimeoutExceedException("Client timed out!") if ( self.process.returncode != 0 or self.remove_trash_from_stderr(stderr) ) and not self.ignore_error: > raise QueryRuntimeException( "Client failed! Return code: {}, stderr: {}".format( self.process.returncode, stderr ), self.process.returncode, stderr, ) E helpers.client.QueryRuntimeException: Client failed! Return code: 115, stderr: Received exception from server (version 25.3.3): E Code: 115. DB::Exception: Received from 172.16.1.9:9000. DB::Exception: Setting object_storage_cluster is neither a builtin setting nor started with the prefix 'custom_' registered for user-defined settings. Stack trace: E E 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000f4b58fb E 1. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x0000000009f80e6c E 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x0000000009f8082b E 3. DB::AccessControl::CustomSettingsPrefixes::checkSettingNameIsAllowed(std::basic_string_view>) const @ 0x000000001232e9f8 E 4. DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000012449944 E 5. DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges&, DB::SettingSource) const @ 0x0000000012449cc3 E 6. DB::Context::checkSettingsConstraintsWithLock(DB::SettingsChanges&, DB::SettingSource) @ 0x00000000130c30b4 E 7. DB::TCPHandler::processQuery(std::optional&) @ 0x0000000014cb4303 E 8. DB::TCPHandler::receivePacketsExpectQuery(std::optional&) @ 0x0000000014ca97f4 E 9. DB::TCPHandler::runImpl() @ 0x0000000014c9cdb9 E 10. DB::TCPHandler::run() @ 0x0000000014cbbaf9 E 11. Poco::Net::TCPServerConnection::start() @ 0x00000000183ecfc7 E 12. Poco::Net::TCPServerDispatcher::run() @ 0x00000000183ed419 E 13. Poco::PooledThread::run() @ 0x00000000183b975b E 14. Poco::ThreadImpl::runnableEntry(void*) @ 0x00000000183b7c3d E 15. ? @ 0x00007f28fa6ebac3 E 16. ? @ 0x00007f28fa77d850 E . (UNKNOWN_SETTING) E (query: SELECT * FROM icebergS3Cluster('cluster_simple', s3, filename = 'iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/', format=Parquet, url = 'http://minio1:9001/root/') SETTINGS object_storage_cluster='cluster_simple') helpers/client.py:248: QueryRuntimeException ------------------------------ Captured log setup ------------------------------ 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: m d o276 e (clientserver.py:501, send_command) ----------------------------- Captured stdout call ----------------------------- 25/05/23 21:10:46 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:46 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:46 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:46 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:46 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:46 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. {} {} {} Upload to bucket: None {} Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None 25/05/23 21:10:46 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:46 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:46 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:46 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:46 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:46 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. {} {} {} Upload to bucket: None Upload to bucket: None {} Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None 25/05/23 21:10:47 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:47 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:47 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:47 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:47 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:47 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. {} {} {} Upload to bucket: None Upload to bucket: None Upload to bucket: None {} Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None ------------------------------ Captured log call ------------------------------- 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: m d o278 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro294 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o294 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: m d o279 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o61 range i0 i100 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: m d o280 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: m d o281 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: m d o282 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: m d o283 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: m d o285 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: m d o286 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: m d o287 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: m d o288 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: m d o290 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: m d o291 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: m d o292 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: m d o293 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: m d o214 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: m d o191 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: m d o243 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: m d o250 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: m d o231 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: m d o260 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: m d o265 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: m d o266 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: m d o153 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro295 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ylo296 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o296 add sa e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro296 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro297 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o295 toDF ro297 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro298 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro299 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o299 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o61 range i1 i101 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro300 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ylo301 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o301 add sb e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro301 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro302 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o300 toDF ro302 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro303 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o303 apply sb e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro304 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro305 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o305 isDefined e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro306 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o306 get e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro307 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro308 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yao309 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o308 applyModifiableSettings ro307 ro309 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o61 parseDataType s"string" e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro310 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o304 cast ro310 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro311 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o303 withColumn sb ro311 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro312 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro313 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro314 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ylo315 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o315 add ro314 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro315 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro316 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro316 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro317 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o313 over ro317 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro318 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o298 withColumn srow_index ro318 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro319 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro320 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro321 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ylo322 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o322 add ro321 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro322 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro323 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro323 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro324 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o320 over ro324 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro325 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o312 withColumn srow_index ro325 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro326 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ylo327 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o327 add srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro327 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro328 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o319 join ro326 ro328 sinner e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro329 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o329 drop srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro330 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o330 writeTo stest_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro331 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o331 tableProperty sformat-version s1 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro332 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o331 using siceberg e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro333 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o331 create e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/data/00000-13-54476bed-019f-45f5-96cf-f7637937962a-00001.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:46 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/snap-8240048132881426541-1-554d139e-06ce-4f6a-aad4-6d68bf5b3ce2.avro HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:46 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/version-hint.text HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:46 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/554d139e-06ce-4f6a-aad4-6d68bf5b3ce2-m0.avro HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:46 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/v1.metadata.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:46 [ 671 ] INFO : Adding another dataframe. result files: ['/iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/data/00000-13-54476bed-019f-45f5-96cf-f7637937962a-00001.parquet', '/iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/snap-8240048132881426541-1-554d139e-06ce-4f6a-aad4-6d68bf5b3ce2.avro', '/iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/version-hint.text', '/iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/554d139e-06ce-4f6a-aad4-6d68bf5b3ce2-m0.avro', '/iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/v1.metadata.json'] (test.py:666, add_df) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro334 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o334 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o61 range i0 i100 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro335 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ylo336 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o336 add sa e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro336 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro337 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o335 toDF ro337 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro338 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro339 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o339 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o61 range i1 i101 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro340 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ylo341 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o341 add sb e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro341 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro342 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o340 toDF ro342 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro343 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o343 apply sb e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro344 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro345 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o345 isDefined e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro346 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o346 get e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro347 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro348 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yao349 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o348 applyModifiableSettings ro347 ro349 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o61 parseDataType s"string" e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro350 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o344 cast ro350 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro351 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o343 withColumn sb ro351 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro352 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro353 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro354 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ylo355 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o355 add ro354 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro355 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro356 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro356 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro357 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o353 over ro357 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro358 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o338 withColumn srow_index ro358 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro359 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro360 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro361 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ylo362 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o362 add ro361 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro362 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro363 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro363 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro364 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o360 over ro364 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro365 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o352 withColumn srow_index ro365 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro366 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ylo367 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o367 add srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro367 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro368 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o359 join ro366 ro368 sinner e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro369 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o369 drop srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro370 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o370 writeTo stest_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro371 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o371 append e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/data/00000-15-57ec3053-4e26-4d01-bc3b-c1f1ba476661-00001.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:46 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/data/00000-13-54476bed-019f-45f5-96cf-f7637937962a-00001.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:46 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/snap-8240048132881426541-1-554d139e-06ce-4f6a-aad4-6d68bf5b3ce2.avro HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:46 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/v2.metadata.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:46 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/snap-8470086534228989666-1-6e2e37c8-4fec-4ab5-980c-a18ca7d6e011.avro HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:46 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/version-hint.text HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:46 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/6e2e37c8-4fec-4ab5-980c-a18ca7d6e011-m0.avro HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:46 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/554d139e-06ce-4f6a-aad4-6d68bf5b3ce2-m0.avro HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:46 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/v1.metadata.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:46 [ 671 ] INFO : Adding another dataframe. result files: ['/iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/data/00000-15-57ec3053-4e26-4d01-bc3b-c1f1ba476661-00001.parquet', '/iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/data/00000-13-54476bed-019f-45f5-96cf-f7637937962a-00001.parquet', '/iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/snap-8240048132881426541-1-554d139e-06ce-4f6a-aad4-6d68bf5b3ce2.avro', '/iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/v2.metadata.json', '/iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/snap-8470086534228989666-1-6e2e37c8-4fec-4ab5-980c-a18ca7d6e011.avro', '/iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/version-hint.text', '/iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/6e2e37c8-4fec-4ab5-980c-a18ca7d6e011-m0.avro', '/iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/554d139e-06ce-4f6a-aad4-6d68bf5b3ce2-m0.avro', '/iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/v1.metadata.json'] (test.py:666, add_df) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro372 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o372 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o61 range i0 i100 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro373 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ylo374 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o374 add sa e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro374 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro375 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o373 toDF ro375 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro376 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro377 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o377 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o61 range i1 i101 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro378 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ylo379 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o379 add sb e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro379 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro380 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o378 toDF ro380 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro381 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o381 apply sb e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro382 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro383 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o383 isDefined e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro384 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o384 get e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro385 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro386 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yao387 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o386 applyModifiableSettings ro385 ro387 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o61 parseDataType s"string" e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro388 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o382 cast ro388 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro389 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o381 withColumn sb ro389 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro390 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro391 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro392 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ylo393 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o393 add ro392 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro393 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro394 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro394 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro395 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o391 over ro395 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro396 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o376 withColumn srow_index ro396 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro397 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro398 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro399 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ylo400 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o400 add ro399 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro400 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro401 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro401 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro402 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o398 over ro402 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro403 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o390 withColumn srow_index ro403 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro404 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ylo405 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o405 add srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro405 e (clientserver.py:501, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Answer received: !yro406 (clientserver.py:512, send_command) 2025-05-23 21:10:46 [ 671 ] DEBUG : Command to send: c o397 join ro404 ro406 sinner e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yro407 (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: c o407 drop srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yro408 (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: c o408 writeTo stest_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yro409 (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: c o409 append e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/data/00000-15-57ec3053-4e26-4d01-bc3b-c1f1ba476661-00001.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:47 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/data/00000-13-54476bed-019f-45f5-96cf-f7637937962a-00001.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:47 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/data/00000-17-9f4e1db9-483f-4678-848f-22056934500b-00001.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:47 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/snap-8240048132881426541-1-554d139e-06ce-4f6a-aad4-6d68bf5b3ce2.avro HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:47 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/v2.metadata.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:47 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/snap-8470086534228989666-1-6e2e37c8-4fec-4ab5-980c-a18ca7d6e011.avro HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:47 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/snap-880468737624832033-1-b43b42e7-4933-4b35-bd5e-5be6977b6335.avro HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:47 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/version-hint.text HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:47 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/6e2e37c8-4fec-4ab5-980c-a18ca7d6e011-m0.avro HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:47 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/554d139e-06ce-4f6a-aad4-6d68bf5b3ce2-m0.avro HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o296 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/b43b42e7-4933-4b35-bd5e-5be6977b6335-m0.avro HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o301 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o309 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o315 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o322 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o294 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o295 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o297 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o298 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o299 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o300 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o302 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o303 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/v1.metadata.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o304 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o305 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o306 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o308 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o310 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o311 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/v3.metadata.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:47 [ 671 ] INFO : Adding another dataframe. result files: ['/iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/data/00000-15-57ec3053-4e26-4d01-bc3b-c1f1ba476661-00001.parquet', '/iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/data/00000-13-54476bed-019f-45f5-96cf-f7637937962a-00001.parquet', '/iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/data/00000-17-9f4e1db9-483f-4678-848f-22056934500b-00001.parquet', '/iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/snap-8240048132881426541-1-554d139e-06ce-4f6a-aad4-6d68bf5b3ce2.avro', '/iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/v2.metadata.json', '/iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/snap-8470086534228989666-1-6e2e37c8-4fec-4ab5-980c-a18ca7d6e011.avro', '/iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/snap-880468737624832033-1-b43b42e7-4933-4b35-bd5e-5be6977b6335.avro', '/iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/version-hint.text', '/iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/6e2e37c8-4fec-4ab5-980c-a18ca7d6e011-m0.avro', '/iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/554d139e-06ce-4f6a-aad4-6d68bf5b3ce2-m0.avro', '/iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/b43b42e7-4933-4b35-bd5e-5be6977b6335-m0.avro', '/iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/v1.metadata.json', '/iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/v3.metadata.json'] (test.py:666, add_df) 2025-05-23 21:10:47 [ 671 ] INFO : Setup complete. files: ['/iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/data/00000-15-57ec3053-4e26-4d01-bc3b-c1f1ba476661-00001.parquet', '/iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/data/00000-13-54476bed-019f-45f5-96cf-f7637937962a-00001.parquet', '/iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/data/00000-17-9f4e1db9-483f-4678-848f-22056934500b-00001.parquet', '/iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/snap-8240048132881426541-1-554d139e-06ce-4f6a-aad4-6d68bf5b3ce2.avro', '/iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/v2.metadata.json', '/iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/snap-8470086534228989666-1-6e2e37c8-4fec-4ab5-980c-a18ca7d6e011.avro', '/iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/snap-880468737624832033-1-b43b42e7-4933-4b35-bd5e-5be6977b6335.avro', '/iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/version-hint.text', '/iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/6e2e37c8-4fec-4ab5-980c-a18ca7d6e011-m0.avro', '/iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/554d139e-06ce-4f6a-aad4-6d68bf5b3ce2-m0.avro', '/iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/b43b42e7-4933-4b35-bd5e-5be6977b6335-m0.avro', '/iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/v1.metadata.json', '/iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/metadata/v3.metadata.json'] (test.py:674, test_cluster_table_function) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Executing query SELECT * FROM system.clusters on node1 (cluster.py:3570, query) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o313 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o314 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o316 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o317 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o318 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o321 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o323 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o327 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o332 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o333 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o336 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o341 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o349 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o355 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o362 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o325 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o326 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o328 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o329 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o330 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o331 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o334 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o335 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o337 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o338 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o339 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o340 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o342 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o343 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o344 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o345 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o346 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o348 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o350 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o351 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o352 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o353 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o354 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o356 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o357 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o358 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o360 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o361 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o363 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o364 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o365 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o367 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o374 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o379 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o387 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o393 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o400 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o405 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o368 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o369 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o370 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o371 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o372 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o373 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o375 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o376 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o377 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o378 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o380 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o381 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o382 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o383 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o384 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o386 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o388 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o389 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o390 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o391 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o392 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o394 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o395 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o396 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o397 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o398 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o399 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o401 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o402 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o403 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o404 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o406 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o407 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o408 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: m d o409 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] INFO : Clusters setup: cluster_simple 1 1 0 1 node1 172.16.1.9 9000 1 default 0 0 0 \N \N \N cluster_simple 1 1 0 2 node2 172.16.1.7 9000 0 default 0 0 0 \N \N \N cluster_simple 1 1 0 3 node3 172.16.1.8 9000 0 default 0 0 0 \N \N \N (test.py:678, test_cluster_table_function) 2025-05-23 21:10:47 [ 671 ] DEBUG : Executing query SELECT * FROM icebergS3(s3, filename = 'iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/', format=Parquet, url = 'http://minio1:9001/root/') on node1 (cluster.py:3570, query) 2025-05-23 21:10:47 [ 671 ] DEBUG : Executing query SELECT * FROM icebergS3Cluster('cluster_simple', s3, filename = 'iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/', format=Parquet, url = 'http://minio1:9001/root/') on node1 (cluster.py:3570, query) 2025-05-23 21:10:47 [ 671 ] DEBUG : Executing query SELECT * FROM icebergS3Cluster('cluster_simple', s3, filename = 'iceberg_data/default/test_iceberg_cluster_1_s3_6bf6efa4_e4f3_47e8_aa90_4d569891ebb1/', format=Parquet, url = 'http://minio1:9001/root/') SETTINGS object_storage_cluster='cluster_simple' on node1 (cluster.py:3570, query) ______________________ test_cluster_table_function[s3-2] _______________________ [gw1] linux -- Python 3.10.12 /usr/bin/python3 started_cluster = format_version = '2', storage_type = 's3' @pytest.mark.parametrize("format_version", ["1", "2"]) @pytest.mark.parametrize("storage_type", ["s3", "azure"]) def test_cluster_table_function(started_cluster, format_version, storage_type): instance = started_cluster.instances["node1"] spark = started_cluster.spark_session TABLE_NAME = ( "test_iceberg_cluster_" + format_version + "_" + storage_type + "_" + get_uuid_str() ) def add_df(mode): write_iceberg_from_df( spark, generate_data(spark, 0, 100), TABLE_NAME, mode=mode, format_version=format_version, ) files = default_upload_directory( started_cluster, storage_type, f"/iceberg_data/default/{TABLE_NAME}/", f"/iceberg_data/default/{TABLE_NAME}/", ) logging.info(f"Adding another dataframe. result files: {files}") return files files = add_df(mode="overwrite") for i in range(1, len(started_cluster.instances)): files = add_df(mode="append") logging.info(f"Setup complete. files: {files}") assert len(files) == 5 + 4 * (len(started_cluster.instances) - 1) clusters = instance.query(f"SELECT * FROM system.clusters") logging.info(f"Clusters setup: {clusters}") # Regular Query only node1 table_function_expr = get_creation_expression( storage_type, TABLE_NAME, started_cluster, table_function=True ) select_regular = ( instance.query(f"SELECT * FROM {table_function_expr}").strip().split() ) def make_query_from_function( run_on_cluster=False, alt_syntax=False, remote=False, storage_type_as_arg=False, storage_type_in_named_collection=False, ): expr = get_creation_expression( storage_type, TABLE_NAME, started_cluster, table_function=True, run_on_cluster=run_on_cluster, storage_type_as_arg=storage_type_as_arg, storage_type_in_named_collection=storage_type_in_named_collection, ) query_id = str(uuid.uuid4()) settings = "SETTINGS object_storage_cluster='cluster_simple'" if alt_syntax else "" if remote: query = f"SELECT * FROM remote('node2', {expr}) {settings}" else: query = f"SELECT * FROM {expr} {settings}" responce = instance.query(query, query_id=query_id).strip().split() return responce, query_id # Cluster Query with node1 as coordinator select_cluster, query_id_cluster = make_query_from_function(run_on_cluster=True) # Cluster Query with node1 as coordinator with alternative syntax > select_cluster_alt_syntax, query_id_cluster_alt_syntax = make_query_from_function( run_on_cluster=True, alt_syntax=True) test_storage_iceberg/test.py:717: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ test_storage_iceberg/test.py:710: in make_query_from_function responce = instance.query(query, query_id=query_id).strip().split() helpers/cluster.py:3571: in query return self.client.query( helpers/client.py:39: in wrap return func(self, *args, **kwargs) helpers/client.py:79: in query ).get_answer() _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = def get_answer(self): self.process.wait(timeout=DEFAULT_QUERY_TIMEOUT) self.stdout_file.seek(0) self.stderr_file.seek(0) stdout = self.stdout_file.read().decode("utf-8", errors="replace") stderr = self.stderr_file.read().decode("utf-8", errors="replace") if ( self.timer is not None and not self.process_finished_before_timeout and not self.ignore_error ): logging.debug(f"Timed out. Last stdout:{stdout}, stderr:{stderr}") raise QueryTimeoutExceedException("Client timed out!") if ( self.process.returncode != 0 or self.remove_trash_from_stderr(stderr) ) and not self.ignore_error: > raise QueryRuntimeException( "Client failed! Return code: {}, stderr: {}".format( self.process.returncode, stderr ), self.process.returncode, stderr, ) E helpers.client.QueryRuntimeException: Client failed! Return code: 115, stderr: Received exception from server (version 25.3.3): E Code: 115. DB::Exception: Received from 172.16.1.9:9000. DB::Exception: Setting object_storage_cluster is neither a builtin setting nor started with the prefix 'custom_' registered for user-defined settings. Stack trace: E E 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000f4b58fb E 1. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x0000000009f80e6c E 2. DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x0000000009f8082b E 3. DB::AccessControl::CustomSettingsPrefixes::checkSettingNameIsAllowed(std::basic_string_view>) const @ 0x000000001232e9f8 E 4. DB::SettingsConstraints::checkImpl(DB::Settings const&, DB::SettingChange&, DB::SettingsConstraints::ReactionOnViolation, DB::SettingSource) const @ 0x0000000012449944 E 5. DB::SettingsConstraints::check(DB::Settings const&, DB::SettingsChanges&, DB::SettingSource) const @ 0x0000000012449cc3 E 6. DB::Context::checkSettingsConstraintsWithLock(DB::SettingsChanges&, DB::SettingSource) @ 0x00000000130c30b4 E 7. DB::TCPHandler::processQuery(std::optional&) @ 0x0000000014cb4303 E 8. DB::TCPHandler::receivePacketsExpectQuery(std::optional&) @ 0x0000000014ca97f4 E 9. DB::TCPHandler::runImpl() @ 0x0000000014c9cdb9 E 10. DB::TCPHandler::run() @ 0x0000000014cbbaf9 E 11. Poco::Net::TCPServerConnection::start() @ 0x00000000183ecfc7 E 12. Poco::Net::TCPServerDispatcher::run() @ 0x00000000183ed419 E 13. Poco::PooledThread::run() @ 0x00000000183b975b E 14. Poco::ThreadImpl::runnableEntry(void*) @ 0x00000000183b7c3d E 15. ? @ 0x00007f28fa6ebac3 E 16. ? @ 0x00007f28fa77d850 E . (UNKNOWN_SETTING) E (query: SELECT * FROM icebergS3Cluster('cluster_simple', s3, filename = 'iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/', format=Parquet, url = 'http://minio1:9001/root/') SETTINGS object_storage_cluster='cluster_simple') helpers/client.py:248: QueryRuntimeException ----------------------------- Captured stdout call ----------------------------- 25/05/23 21:10:47 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:47 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:47 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:47 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:47 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:47 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. {} {} {} Upload to bucket: None {} Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None 25/05/23 21:10:48 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:48 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:48 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:48 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:48 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:48 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. {} {} {} Upload to bucket: None Upload to bucket: None {} Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None 25/05/23 21:10:48 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:48 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:48 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:48 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:48 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:48 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. {} {} {} Upload to bucket: None Upload to bucket: None Upload to bucket: None {} Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None ------------------------------ Captured log call ------------------------------- 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yro410 (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: c o410 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: c o61 range i0 i100 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yro411 (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !ylo412 (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: c o412 add sa e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro412 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yro413 (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: c o411 toDF ro413 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yro414 (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yro415 (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: c o415 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: c o61 range i1 i101 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yro416 (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !ylo417 (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: c o417 add sb e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro417 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yro418 (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: c o416 toDF ro418 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yro419 (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: c o419 apply sb e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yro420 (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yro421 (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: c o421 isDefined e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yro422 (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: c o422 get e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yro423 (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yro424 (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yao425 (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: c o424 applyModifiableSettings ro423 ro425 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: c o61 parseDataType s"string" e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yro426 (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: c o420 cast ro426 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yro427 (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: c o419 withColumn sb ro427 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yro428 (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yro429 (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yro430 (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !ylo431 (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: c o431 add ro430 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro431 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yro432 (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro432 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yro433 (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: c o429 over ro433 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yro434 (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: c o414 withColumn srow_index ro434 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yro435 (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yro436 (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yro437 (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !ylo438 (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: c o438 add ro437 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro438 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yro439 (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro439 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yro440 (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: c o436 over ro440 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yro441 (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: c o428 withColumn srow_index ro441 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yro442 (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !ylo443 (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: c o443 add srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro443 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yro444 (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: c o435 join ro442 ro444 sinner e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yro445 (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: c o445 drop srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yro446 (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: c o446 writeTo stest_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yro447 (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: c o447 tableProperty sformat-version s2 e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yro448 (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: c o447 using siceberg e (clientserver.py:501, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Answer received: !yro449 (clientserver.py:512, send_command) 2025-05-23 21:10:47 [ 671 ] DEBUG : Command to send: c o447 create e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/data/00000-19-f2f06bb3-29f4-4b47-a506-75f80853f383-00001.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:48 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/2a2514d8-8b0d-4105-a6c1-019cc258c822-m0.avro HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:48 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/snap-5578388933013866939-1-2a2514d8-8b0d-4105-a6c1-019cc258c822.avro HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:48 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/version-hint.text HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:48 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/v1.metadata.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:48 [ 671 ] INFO : Adding another dataframe. result files: ['/iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/data/00000-19-f2f06bb3-29f4-4b47-a506-75f80853f383-00001.parquet', '/iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/2a2514d8-8b0d-4105-a6c1-019cc258c822-m0.avro', '/iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/snap-5578388933013866939-1-2a2514d8-8b0d-4105-a6c1-019cc258c822.avro', '/iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/version-hint.text', '/iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/v1.metadata.json'] (test.py:666, add_df) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro450 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o450 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o61 range i0 i100 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro451 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ylo452 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o452 add sa e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro452 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro453 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o451 toDF ro453 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro454 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro455 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o455 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o61 range i1 i101 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro456 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ylo457 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o457 add sb e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro457 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro458 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o456 toDF ro458 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro459 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o459 apply sb e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro460 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro461 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o461 isDefined e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro462 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o462 get e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro463 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro464 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yao465 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o464 applyModifiableSettings ro463 ro465 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o61 parseDataType s"string" e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro466 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o460 cast ro466 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro467 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o459 withColumn sb ro467 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro468 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro469 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro470 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ylo471 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o471 add ro470 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro471 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro472 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro472 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro473 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o469 over ro473 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro474 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o454 withColumn srow_index ro474 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro475 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro476 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro477 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ylo478 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o478 add ro477 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro478 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro479 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro479 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro480 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o476 over ro480 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro481 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o468 withColumn srow_index ro481 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro482 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ylo483 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o483 add srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro483 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro484 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o475 join ro482 ro484 sinner e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro485 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o485 drop srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro486 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o486 writeTo stest_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro487 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o487 append e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o324 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o312 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o319 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o320 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o307 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o359 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o366 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o347 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o412 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o417 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o425 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o431 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o438 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o443 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o410 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o411 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o413 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o414 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o415 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o416 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o418 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o419 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o420 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o421 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o422 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o424 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o426 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/data/00000-21-3166b42d-123f-463e-9b34-6f2473348385-00001.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o427 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o428 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o429 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o430 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o432 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o433 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o434 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o435 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o436 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o437 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o439 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o440 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o441 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o442 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o444 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o445 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o448 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o449 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o452 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/data/00000-19-f2f06bb3-29f4-4b47-a506-75f80853f383-00001.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o457 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o465 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o471 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o478 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o483 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o269 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o385 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o447 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o446 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o423 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o450 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o451 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o453 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/v2.metadata.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o454 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o455 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o456 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o458 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o459 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o460 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o461 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o462 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o464 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o466 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o467 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o468 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o469 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o470 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o472 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o473 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/2a2514d8-8b0d-4105-a6c1-019cc258c822-m0.avro HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o474 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o475 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o476 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o477 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o479 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o480 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o481 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o482 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o484 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o485 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o486 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: m d o487 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/snap-5578388933013866939-1-2a2514d8-8b0d-4105-a6c1-019cc258c822.avro HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:48 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/version-hint.text HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:48 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/snap-2951964323669480012-1-bac5d83e-03ec-4299-894f-9ba511224669.avro HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:48 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/v1.metadata.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:48 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/bac5d83e-03ec-4299-894f-9ba511224669-m0.avro HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:48 [ 671 ] INFO : Adding another dataframe. result files: ['/iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/data/00000-21-3166b42d-123f-463e-9b34-6f2473348385-00001.parquet', '/iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/data/00000-19-f2f06bb3-29f4-4b47-a506-75f80853f383-00001.parquet', '/iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/v2.metadata.json', '/iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/2a2514d8-8b0d-4105-a6c1-019cc258c822-m0.avro', '/iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/snap-5578388933013866939-1-2a2514d8-8b0d-4105-a6c1-019cc258c822.avro', '/iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/version-hint.text', '/iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/snap-2951964323669480012-1-bac5d83e-03ec-4299-894f-9ba511224669.avro', '/iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/v1.metadata.json', '/iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/bac5d83e-03ec-4299-894f-9ba511224669-m0.avro'] (test.py:666, add_df) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro488 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o488 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o61 range i0 i100 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro489 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ylo490 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o490 add sa e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro490 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro491 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o489 toDF ro491 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro492 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro493 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o493 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o61 range i1 i101 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro494 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ylo495 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o495 add sb e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro495 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro496 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o494 toDF ro496 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro497 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o497 apply sb e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro498 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro499 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o499 isDefined e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro500 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o500 get e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro501 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro502 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yao503 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o502 applyModifiableSettings ro501 ro503 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o61 parseDataType s"string" e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro504 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o498 cast ro504 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro505 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o497 withColumn sb ro505 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro506 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro507 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro508 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ylo509 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o509 add ro508 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro509 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro510 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro510 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro511 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o507 over ro511 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro512 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o492 withColumn srow_index ro512 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro513 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro514 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro515 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ylo516 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o516 add ro515 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro516 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro517 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro517 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro518 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o514 over ro518 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro519 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o506 withColumn srow_index ro519 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro520 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ylo521 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o521 add srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro521 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro522 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o513 join ro520 ro522 sinner e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro523 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o523 drop srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro524 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o524 writeTo stest_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9 e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yro525 (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Command to send: c o525 append e (clientserver.py:501, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:48 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/data/00000-21-3166b42d-123f-463e-9b34-6f2473348385-00001.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:48 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/data/00000-23-253e8322-22a9-4354-9be1-f93ab0bd2cb9-00001.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:48 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/data/00000-19-f2f06bb3-29f4-4b47-a506-75f80853f383-00001.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:48 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/snap-8828424081200676906-1-aa89c60d-3546-464b-aefd-ae031a803466.avro HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:48 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/v2.metadata.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:48 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/2a2514d8-8b0d-4105-a6c1-019cc258c822-m0.avro HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:48 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/snap-5578388933013866939-1-2a2514d8-8b0d-4105-a6c1-019cc258c822.avro HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:48 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/version-hint.text HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:48 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/aa89c60d-3546-464b-aefd-ae031a803466-m0.avro HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:48 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/snap-2951964323669480012-1-bac5d83e-03ec-4299-894f-9ba511224669.avro HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:48 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/v1.metadata.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:48 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/v3.metadata.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:48 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/bac5d83e-03ec-4299-894f-9ba511224669-m0.avro HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:48 [ 671 ] INFO : Adding another dataframe. result files: ['/iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/data/00000-21-3166b42d-123f-463e-9b34-6f2473348385-00001.parquet', '/iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/data/00000-23-253e8322-22a9-4354-9be1-f93ab0bd2cb9-00001.parquet', '/iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/data/00000-19-f2f06bb3-29f4-4b47-a506-75f80853f383-00001.parquet', '/iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/snap-8828424081200676906-1-aa89c60d-3546-464b-aefd-ae031a803466.avro', '/iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/v2.metadata.json', '/iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/2a2514d8-8b0d-4105-a6c1-019cc258c822-m0.avro', '/iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/snap-5578388933013866939-1-2a2514d8-8b0d-4105-a6c1-019cc258c822.avro', '/iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/version-hint.text', '/iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/aa89c60d-3546-464b-aefd-ae031a803466-m0.avro', '/iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/snap-2951964323669480012-1-bac5d83e-03ec-4299-894f-9ba511224669.avro', '/iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/v1.metadata.json', '/iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/v3.metadata.json', '/iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/bac5d83e-03ec-4299-894f-9ba511224669-m0.avro'] (test.py:666, add_df) 2025-05-23 21:10:48 [ 671 ] INFO : Setup complete. files: ['/iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/data/00000-21-3166b42d-123f-463e-9b34-6f2473348385-00001.parquet', '/iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/data/00000-23-253e8322-22a9-4354-9be1-f93ab0bd2cb9-00001.parquet', '/iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/data/00000-19-f2f06bb3-29f4-4b47-a506-75f80853f383-00001.parquet', '/iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/snap-8828424081200676906-1-aa89c60d-3546-464b-aefd-ae031a803466.avro', '/iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/v2.metadata.json', '/iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/2a2514d8-8b0d-4105-a6c1-019cc258c822-m0.avro', '/iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/snap-5578388933013866939-1-2a2514d8-8b0d-4105-a6c1-019cc258c822.avro', '/iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/version-hint.text', '/iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/aa89c60d-3546-464b-aefd-ae031a803466-m0.avro', '/iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/snap-2951964323669480012-1-bac5d83e-03ec-4299-894f-9ba511224669.avro', '/iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/v1.metadata.json', '/iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/v3.metadata.json', '/iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/metadata/bac5d83e-03ec-4299-894f-9ba511224669-m0.avro'] (test.py:674, test_cluster_table_function) 2025-05-23 21:10:48 [ 671 ] DEBUG : Executing query SELECT * FROM system.clusters on node1 (cluster.py:3570, query) 2025-05-23 21:10:48 [ 671 ] INFO : Clusters setup: cluster_simple 1 1 0 1 node1 172.16.1.9 9000 1 default 0 0 0 \N \N \N cluster_simple 1 1 0 2 node2 172.16.1.7 9000 0 default 0 0 0 \N \N \N cluster_simple 1 1 0 3 node3 172.16.1.8 9000 0 default 0 0 0 \N \N \N (test.py:678, test_cluster_table_function) 2025-05-23 21:10:48 [ 671 ] DEBUG : Executing query SELECT * FROM icebergS3(s3, filename = 'iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/', format=Parquet, url = 'http://minio1:9001/root/') on node1 (cluster.py:3570, query) 2025-05-23 21:10:48 [ 671 ] DEBUG : Executing query SELECT * FROM icebergS3Cluster('cluster_simple', s3, filename = 'iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/', format=Parquet, url = 'http://minio1:9001/root/') on node1 (cluster.py:3570, query) 2025-05-23 21:10:48 [ 671 ] DEBUG : Executing query SELECT * FROM icebergS3Cluster('cluster_simple', s3, filename = 'iceberg_data/default/test_iceberg_cluster_2_s3_2dff5195_6474_4edc_b76a_0a259abf88e9/', format=Parquet, url = 'http://minio1:9001/root/') SETTINGS object_storage_cluster='cluster_simple' on node1 (cluster.py:3570, query) __________________________ test_delete_files[azure-1] __________________________ [gw1] linux -- Python 3.10.12 /usr/bin/python3 started_cluster = format_version = '1', storage_type = 'azure' @pytest.mark.parametrize("format_version", ["1", "2"]) @pytest.mark.parametrize("storage_type", ["s3", "azure", "local"]) def test_delete_files(started_cluster, format_version, storage_type): instance = started_cluster.instances["node1"] spark = started_cluster.spark_session TABLE_NAME = ( "test_delete_files_" + format_version + "_" + storage_type + "_" + get_uuid_str() ) write_iceberg_from_df( spark, generate_data(spark, 0, 100), TABLE_NAME, mode="overwrite", format_version=format_version, ) default_upload_directory( started_cluster, storage_type, f"/iceberg_data/default/{TABLE_NAME}/", f"/iceberg_data/default/{TABLE_NAME}/", ) create_iceberg_table(storage_type, instance, TABLE_NAME, started_cluster) # Test trivial count with deleted files query_id = "test_trivial_count_" + get_uuid_str() assert int(instance.query(f"SELECT count() FROM {TABLE_NAME}", query_id=query_id)) == 100 instance.query("SYSTEM FLUSH LOGS") > assert instance.query(f"SELECT ProfileEvents['IcebergTrivialCountOptimizationApplied'] FROM system.query_log where query_id = '{query_id}' and type = 'QueryFinish'") == "1\n" E AssertionError: assert '0\n' == '1\n' E - 1 E + 0 test_storage_iceberg/test.py:861: AssertionError ----------------------------- Captured stdout call ----------------------------- 25/05/23 21:10:49 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:49 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:49 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:49 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:49 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:49 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. {} {} {} ------------------------------ Captured log call ------------------------------- 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yro526 (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: c o526 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: c o61 range i0 i100 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yro527 (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !ylo528 (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: c o528 add sa e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro528 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yro529 (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: c o527 toDF ro529 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yro530 (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yro531 (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: c o531 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: c o61 range i1 i101 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yro532 (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !ylo533 (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: c o533 add sb e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro533 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yro534 (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: c o532 toDF ro534 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yro535 (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: c o535 apply sb e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yro536 (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yro537 (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: c o537 isDefined e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yro538 (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: c o538 get e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yro539 (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yro540 (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yao541 (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: c o540 applyModifiableSettings ro539 ro541 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: c o61 parseDataType s"string" e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yro542 (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: c o536 cast ro542 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yro543 (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: c o535 withColumn sb ro543 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yro544 (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yro545 (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yro546 (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !ylo547 (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: c o547 add ro546 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro547 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yro548 (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro548 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yro549 (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: c o545 over ro549 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yro550 (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: c o530 withColumn srow_index ro550 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yro551 (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yro552 (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yro553 (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !ylo554 (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: c o554 add ro553 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro554 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yro555 (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro555 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yro556 (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: c o552 over ro556 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yro557 (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: c o544 withColumn srow_index ro557 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yro558 (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !ylo559 (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: c o559 add srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro559 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yro560 (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: c o551 join ro558 ro560 sinner e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yro561 (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: c o561 drop srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yro562 (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: c o562 writeTo stest_delete_files_1_azure_4c6da24d_7c3c_442e_a062_3314dce6c397 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yro563 (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: c o563 tableProperty sformat-version s1 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yro564 (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: c o563 using siceberg e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yro565 (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: c o563 create e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o490 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o495 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o503 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o488 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o489 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o491 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o493 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o494 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o496 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o497 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o498 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o499 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o500 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o502 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o504 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o505 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o509 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o516 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o521 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o507 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o508 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o510 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o511 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o512 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o513 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o514 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o515 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o517 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o518 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o519 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o520 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o522 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o523 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o524 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o525 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o492 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o506 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o528 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o533 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o541 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o547 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o554 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o559 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o526 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o527 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o529 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o530 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o531 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o532 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o534 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o535 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o536 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o537 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o538 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o540 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o542 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o543 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o544 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o545 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o546 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o548 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o549 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o550 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o551 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o552 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o553 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o555 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o556 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o557 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o558 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o560 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o561 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o564 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Command to send: m d o565 e (clientserver.py:501, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:49 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_delete_files_1_azure_4c6da24d_7c3c_442e_a062_3314dce6c397/data/00000-25-0a913e6d-9888-46d0-b1dd-d24209459fde-00001.parquet' Request method: 'PUT' Request headers: 'Content-Length': '967' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '66e2f798-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:49 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_delete_files_1_azure_4c6da24d_7c3c_442e_a062_3314dce6c397/data/00000-25-0a913e6d-9888-46d0-b1dd-d24209459fde-00001.parquet HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:49 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x23F21FE9392EF00"' 'last-modified': 'Fri, 23 May 2025 21:10:49 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '66e2f798-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '1b86b2fa-793c-4d14-85ac-a531b14fc5ec' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:49 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:49 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_delete_files_1_azure_4c6da24d_7c3c_442e_a062_3314dce6c397/metadata/snap-4211133307464503717-1-0f31a056-dd75-4eb0-8b5f-79eb6e938890.avro' Request method: 'PUT' Request headers: 'Content-Length': '3792' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '66e47a5a-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:49 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_delete_files_1_azure_4c6da24d_7c3c_442e_a062_3314dce6c397/metadata/snap-4211133307464503717-1-0f31a056-dd75-4eb0-8b5f-79eb6e938890.avro HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:49 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x1FA1648AFBFB380"' 'last-modified': 'Fri, 23 May 2025 21:10:49 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '66e47a5a-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '05eccd78-7233-4c0d-b2dd-d87a699d84c5' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:49 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:49 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_delete_files_1_azure_4c6da24d_7c3c_442e_a062_3314dce6c397/metadata/0f31a056-dd75-4eb0-8b5f-79eb6e938890-m0.avro' Request method: 'PUT' Request headers: 'Content-Length': '5822' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '66e61086-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:49 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_delete_files_1_azure_4c6da24d_7c3c_442e_a062_3314dce6c397/metadata/0f31a056-dd75-4eb0-8b5f-79eb6e938890-m0.avro HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:49 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x1BC8CACFFF901D0"' 'last-modified': 'Fri, 23 May 2025 21:10:49 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '66e61086-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '516637d7-8314-496a-a3a1-91c9ce3d0416' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:49 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:49 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_delete_files_1_azure_4c6da24d_7c3c_442e_a062_3314dce6c397/metadata/version-hint.text' Request method: 'PUT' Request headers: 'Content-Length': '1' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '66e73da8-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:49 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_delete_files_1_azure_4c6da24d_7c3c_442e_a062_3314dce6c397/metadata/version-hint.text HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:49 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x211DF537DDA7A00"' 'last-modified': 'Fri, 23 May 2025 21:10:49 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '66e73da8-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '048c4699-a7cc-429f-b9db-c7df3fa65646' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:49 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:49 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_delete_files_1_azure_4c6da24d_7c3c_442e_a062_3314dce6c397/metadata/v1.metadata.json' Request method: 'PUT' Request headers: 'Content-Length': '2174' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '66e85904-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:49 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_delete_files_1_azure_4c6da24d_7c3c_442e_a062_3314dce6c397/metadata/v1.metadata.json HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:49 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x1E9D74B10D4BC70"' 'last-modified': 'Fri, 23 May 2025 21:10:49 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '66e85904-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '755d0a83-bf78-4c2b-9ab7-73124c6e4cef' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:49 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:49 [ 671 ] DEBUG : Executing query DROP TABLE IF EXISTS test_delete_files_1_azure_4c6da24d_7c3c_442e_a062_3314dce6c397 SYNC on node1 (cluster.py:3570, query) 2025-05-23 21:10:49 [ 671 ] DEBUG : Executing query DROP TABLE IF EXISTS test_delete_files_1_azure_4c6da24d_7c3c_442e_a062_3314dce6c397; CREATE TABLE test_delete_files_1_azure_4c6da24d_7c3c_442e_a062_3314dce6c397 ENGINE=IcebergAzure(azure, container = mycontainer, storage_account_url = 'http://azurite1:30050/devstoreaccount1', blob_path = '/iceberg_data/default/test_delete_files_1_azure_4c6da24d_7c3c_442e_a062_3314dce6c397/', format=Parquet) on node1 (cluster.py:3570, query) 2025-05-23 21:10:49 [ 671 ] DEBUG : Executing query SELECT count() FROM test_delete_files_1_azure_4c6da24d_7c3c_442e_a062_3314dce6c397 on node1 (cluster.py:3570, query) 2025-05-23 21:10:49 [ 671 ] DEBUG : Executing query SYSTEM FLUSH LOGS on node1 (cluster.py:3570, query) 2025-05-23 21:10:49 [ 671 ] DEBUG : Executing query SELECT ProfileEvents['IcebergTrivialCountOptimizationApplied'] FROM system.query_log where query_id = 'test_trivial_count_63c8227f_4160_469b_9e77_02bca6857df5' and type = 'QueryFinish' on node1 (cluster.py:3570, query) __________________________ test_delete_files[azure-2] __________________________ [gw1] linux -- Python 3.10.12 /usr/bin/python3 started_cluster = format_version = '2', storage_type = 'azure' @pytest.mark.parametrize("format_version", ["1", "2"]) @pytest.mark.parametrize("storage_type", ["s3", "azure", "local"]) def test_delete_files(started_cluster, format_version, storage_type): instance = started_cluster.instances["node1"] spark = started_cluster.spark_session TABLE_NAME = ( "test_delete_files_" + format_version + "_" + storage_type + "_" + get_uuid_str() ) write_iceberg_from_df( spark, generate_data(spark, 0, 100), TABLE_NAME, mode="overwrite", format_version=format_version, ) default_upload_directory( started_cluster, storage_type, f"/iceberg_data/default/{TABLE_NAME}/", f"/iceberg_data/default/{TABLE_NAME}/", ) create_iceberg_table(storage_type, instance, TABLE_NAME, started_cluster) # Test trivial count with deleted files query_id = "test_trivial_count_" + get_uuid_str() assert int(instance.query(f"SELECT count() FROM {TABLE_NAME}", query_id=query_id)) == 100 instance.query("SYSTEM FLUSH LOGS") > assert instance.query(f"SELECT ProfileEvents['IcebergTrivialCountOptimizationApplied'] FROM system.query_log where query_id = '{query_id}' and type = 'QueryFinish'") == "1\n" E AssertionError: assert '0\n' == '1\n' E - 1 E + 0 test_storage_iceberg/test.py:861: AssertionError ----------------------------- Captured stdout call ----------------------------- 25/05/23 21:10:50 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:50 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:50 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:50 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:50 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:50 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. {} {} {} ------------------------------ Captured log call ------------------------------- 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro566 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c o566 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c o61 range i0 i100 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro567 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ylo568 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c o568 add sa e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro568 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro569 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c o567 toDF ro569 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro570 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro571 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c o571 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c o61 range i1 i101 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro572 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ylo573 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c o573 add sb e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro573 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro574 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c o572 toDF ro574 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro575 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c o575 apply sb e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro576 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro577 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c o577 isDefined e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro578 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c o578 get e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro579 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro580 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yao581 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c o580 applyModifiableSettings ro579 ro581 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c o61 parseDataType s"string" e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro582 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c o576 cast ro582 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro583 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c o575 withColumn sb ro583 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro584 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro585 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro586 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ylo587 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c o587 add ro586 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro587 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro588 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro588 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro589 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c o585 over ro589 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro590 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c o570 withColumn srow_index ro590 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro591 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro592 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro593 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ylo594 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c o594 add ro593 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro594 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro595 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro595 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro596 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c o592 over ro596 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro597 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c o584 withColumn srow_index ro597 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro598 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ylo599 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c o599 add srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro599 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro600 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c o591 join ro598 ro600 sinner e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro601 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c o601 drop srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro602 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c o602 writeTo stest_delete_files_2_azure_4f90bbdd_24a5_406d_ad17_e217e065d078 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro603 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c o603 tableProperty sformat-version s2 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro604 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c o603 using siceberg e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro605 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c o603 create e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_delete_files_2_azure_4f90bbdd_24a5_406d_ad17_e217e065d078/data/00000-27-59567c7c-0e6e-4901-a05f-61e7d0764a1d-00001.parquet' Request method: 'PUT' Request headers: 'Content-Length': '967' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '676aeaea-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:50 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_delete_files_2_azure_4f90bbdd_24a5_406d_ad17_e217e065d078/data/00000-27-59567c7c-0e6e-4901-a05f-61e7d0764a1d-00001.parquet HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:50 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x1BDC11A3EAA4890"' 'last-modified': 'Fri, 23 May 2025 21:10:50 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '676aeaea-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '8b327f7f-7f4b-43c4-98ad-a71eed35b81a' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:50 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:50 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_delete_files_2_azure_4f90bbdd_24a5_406d_ad17_e217e065d078/metadata/snap-1892747457845525738-1-189ec54e-9506-4e8e-a991-a641a49fe1b8.avro' Request method: 'PUT' Request headers: 'Content-Length': '4291' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '676c7914-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:50 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_delete_files_2_azure_4f90bbdd_24a5_406d_ad17_e217e065d078/metadata/snap-1892747457845525738-1-189ec54e-9506-4e8e-a991-a641a49fe1b8.avro HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:50 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x205B99F44D3CF80"' 'last-modified': 'Fri, 23 May 2025 21:10:50 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '676c7914-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': 'fa7cfe8b-f9e3-4188-9773-c5eb10ad5d2e' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:50 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:50 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_delete_files_2_azure_4f90bbdd_24a5_406d_ad17_e217e065d078/metadata/189ec54e-9506-4e8e-a991-a641a49fe1b8-m0.avro' Request method: 'PUT' Request headers: 'Content-Length': '6709' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '676de4e8-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: m d o563 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: m d o562 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: m d o568 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: m d o573 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: m d o581 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: m d o587 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: m d o594 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: m d o599 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: m d o566 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: m d o567 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: m d o569 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: m d o570 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: m d o571 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: m d o572 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: m d o574 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: m d o575 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: m d o576 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: m d o577 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: m d o578 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: m d o580 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: m d o582 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: m d o583 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: m d o584 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: m d o585 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: m d o586 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: m d o588 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: m d o589 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: m d o590 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_delete_files_2_azure_4f90bbdd_24a5_406d_ad17_e217e065d078/metadata/189ec54e-9506-4e8e-a991-a641a49fe1b8-m0.avro HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:50 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x264CF7B86E9AF40"' 'last-modified': 'Fri, 23 May 2025 21:10:50 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '676de4e8-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '67d93e34-837a-4b43-b3b0-317ed1957a12' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:50 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: m d o591 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: m d o592 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_delete_files_2_azure_4f90bbdd_24a5_406d_ad17_e217e065d078/metadata/version-hint.text' Request method: 'PUT' Request headers: 'Content-Length': '1' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '676f9efa-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: m d o593 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: m d o595 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: m d o596 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: m d o597 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: m d o598 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: m d o600 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: m d o601 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: m d o604 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: m d o605 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_delete_files_2_azure_4f90bbdd_24a5_406d_ad17_e217e065d078/metadata/version-hint.text HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:50 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x1E6A15A22131190"' 'last-modified': 'Fri, 23 May 2025 21:10:50 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '676f9efa-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': 'b1b48261-b59a-4749-b2c8-55386197c07c' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:50 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:50 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_delete_files_2_azure_4f90bbdd_24a5_406d_ad17_e217e065d078/metadata/v1.metadata.json' Request method: 'PUT' Request headers: 'Content-Length': '1935' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '67711294-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:50 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_delete_files_2_azure_4f90bbdd_24a5_406d_ad17_e217e065d078/metadata/v1.metadata.json HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:50 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x1FC392F56DBD800"' 'last-modified': 'Fri, 23 May 2025 21:10:50 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '67711294-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': 'f716ba35-b1f3-4555-b830-deae1903646d' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:50 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:50 [ 671 ] DEBUG : Executing query DROP TABLE IF EXISTS test_delete_files_2_azure_4f90bbdd_24a5_406d_ad17_e217e065d078 SYNC on node1 (cluster.py:3570, query) 2025-05-23 21:10:50 [ 671 ] DEBUG : Executing query DROP TABLE IF EXISTS test_delete_files_2_azure_4f90bbdd_24a5_406d_ad17_e217e065d078; CREATE TABLE test_delete_files_2_azure_4f90bbdd_24a5_406d_ad17_e217e065d078 ENGINE=IcebergAzure(azure, container = mycontainer, storage_account_url = 'http://azurite1:30050/devstoreaccount1', blob_path = '/iceberg_data/default/test_delete_files_2_azure_4f90bbdd_24a5_406d_ad17_e217e065d078/', format=Parquet) on node1 (cluster.py:3570, query) 2025-05-23 21:10:50 [ 671 ] DEBUG : Executing query SELECT count() FROM test_delete_files_2_azure_4f90bbdd_24a5_406d_ad17_e217e065d078 on node1 (cluster.py:3570, query) 2025-05-23 21:10:50 [ 671 ] DEBUG : Executing query SYSTEM FLUSH LOGS on node1 (cluster.py:3570, query) 2025-05-23 21:10:50 [ 671 ] DEBUG : Executing query SELECT ProfileEvents['IcebergTrivialCountOptimizationApplied'] FROM system.query_log where query_id = 'test_trivial_count_bcb2a2ac_6f8d_40b8_a42a_a043a744425c' and type = 'QueryFinish' on node1 (cluster.py:3570, query) __________________________ test_delete_files[local-1] __________________________ [gw1] linux -- Python 3.10.12 /usr/bin/python3 started_cluster = format_version = '1', storage_type = 'local' @pytest.mark.parametrize("format_version", ["1", "2"]) @pytest.mark.parametrize("storage_type", ["s3", "azure", "local"]) def test_delete_files(started_cluster, format_version, storage_type): instance = started_cluster.instances["node1"] spark = started_cluster.spark_session TABLE_NAME = ( "test_delete_files_" + format_version + "_" + storage_type + "_" + get_uuid_str() ) write_iceberg_from_df( spark, generate_data(spark, 0, 100), TABLE_NAME, mode="overwrite", format_version=format_version, ) default_upload_directory( started_cluster, storage_type, f"/iceberg_data/default/{TABLE_NAME}/", f"/iceberg_data/default/{TABLE_NAME}/", ) create_iceberg_table(storage_type, instance, TABLE_NAME, started_cluster) # Test trivial count with deleted files query_id = "test_trivial_count_" + get_uuid_str() assert int(instance.query(f"SELECT count() FROM {TABLE_NAME}", query_id=query_id)) == 100 instance.query("SYSTEM FLUSH LOGS") > assert instance.query(f"SELECT ProfileEvents['IcebergTrivialCountOptimizationApplied'] FROM system.query_log where query_id = '{query_id}' and type = 'QueryFinish'") == "1\n" E AssertionError: assert '0\n' == '1\n' E - 1 E + 0 test_storage_iceberg/test.py:861: AssertionError ----------------------------- Captured stdout call ----------------------------- 25/05/23 21:10:51 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:51 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:51 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:51 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:51 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:51 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. {} {} {} ------------------------------ Captured log call ------------------------------- 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro606 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c o606 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c o61 range i0 i100 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro607 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ylo608 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c o608 add sa e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro608 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro609 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c o607 toDF ro609 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro610 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro611 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c o611 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c o61 range i1 i101 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro612 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ylo613 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c o613 add sb e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro613 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro614 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c o612 toDF ro614 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro615 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c o615 apply sb e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro616 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro617 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c o617 isDefined e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro618 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c o618 get e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro619 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro620 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yao621 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c o620 applyModifiableSettings ro619 ro621 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c o61 parseDataType s"string" e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro622 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c o616 cast ro622 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro623 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c o615 withColumn sb ro623 e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro624 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro625 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Answer received: !yro626 (clientserver.py:512, send_command) 2025-05-23 21:10:50 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !ylo627 (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: c o627 add ro626 e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro627 e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yro628 (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro628 e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yro629 (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: c o625 over ro629 e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yro630 (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: c o610 withColumn srow_index ro630 e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yro631 (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yro632 (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yro633 (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !ylo634 (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: c o634 add ro633 e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro634 e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yro635 (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro635 e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yro636 (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: c o632 over ro636 e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yro637 (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: c o624 withColumn srow_index ro637 e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yro638 (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !ylo639 (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: c o639 add srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro639 e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yro640 (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: c o631 join ro638 ro640 sinner e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yro641 (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: c o641 drop srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yro642 (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: c o642 writeTo stest_delete_files_1_local_cfef13ac_d853_40d3_9aa3_0372c5be3b5c e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yro643 (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: c o643 tableProperty sformat-version s1 e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yro644 (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: c o643 using siceberg e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yro645 (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: c o643 create e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : run container_id:rootteststorageiceberg-gw1-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p /iceberg_data/default/test_delete_files_1_local_cfef13ac_d853_40d3_9aa3_0372c5be3b5c/data'] (cluster.py:2045, exec_in_container) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command:[docker exec rootteststorageiceberg-gw1-node1-1 bash -c mkdir -p /iceberg_data/default/test_delete_files_1_local_cfef13ac_d853_40d3_9aa3_0372c5be3b5c/data] (cluster.py:121, run_and_check) 2025-05-23 21:10:51 [ 671 ] DEBUG : run container_id:rootteststorageiceberg-gw1-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname /iceberg_data/default/test_delete_files_1_local_cfef13ac_d853_40d3_9aa3_0372c5be3b5c/data/00000-29-56d49e66-a41c-4f64-a499-bc48241928dd-00001.parquet) && echo UEFSMRUAFcAMFfYCFb3z1JUGHBXIARUAFQgVCAAAH4sIAAAAAAAAAC3F1yICAAAAwJBZIVskK7OyM0OK7IzKjvL//+DB3csFAv9a3Oo2B93uDne6y93ucchhR9zrPvc76gEPesjDHvGoxzzumCc86binnPC0ZzzrOc876QUvesnLXvGqU0474zWve8Ob3vK2d5z1rve87wMf+sg5H/vEp877zAUXfe4Ll3zpK1/7xre+873LfvCjn/zsiquu+cWvfvO7P/zpL9f97R833PSv/wACwudxIAMAABUAFaAJFeoCFY28v7gJHBXIARUAFQgVCAAAH4sIAAAAAAAAAB3SsYFCMQxEwQ/XEFiyJPffGOdJXrST7et5nu/rP+smbvJm39RN38zNed/xR7+6NDR1a2nrKLvYxS52sYtd7GIXu9jFBhtssMEGG2ywwQYbbLLJJptssskmm2yyyW52s5vd7GY3u9nNbnazxRZbbLHFFltsscUW22yzzTbbbLPNNttss8MOO+ywww477LDDDnvYwx72sIc97GEPe9hz/nzj8wPU24atUAIAABkRAhkYCAAAAAAAAAAAGRgIYwAAAAAAAAAVAhkWAAAZEQIZGAExGRgCOTkVAhkWAAAZHBYIFaoDFgAAABkcFrIDFZ4DFgAAABUCGTxIBXRhYmxlFQQAFQQlABgBYVUCABUMJQAYAWIlADUEHBwAAAAWyAEZHBksJggcFQQZJQAIGRgBYRUEFsgBFvQMFqoDJgg8GAhjAAAAAAAAABgIAAAAAAAAAAAWACgIYwAAAAAAAAAYCAAAAAAAAAAAABkcFQAVABUCAAAWsgcVFhbQBhU+ACayAxwVDBklAAgZGAFiFQQWyAEW1AkWngMmsgM8NgAoAjk5GAExABkcFQAVABUCAAAWyAcVGBaOBxUkABbIFhbIASYIFsgGFAAAGRwYDmljZWJlcmcuc2NoZW1hGJABeyJ0eXBlIjoic3RydWN0Iiwic2NoZW1hLWlkIjowLCJmaWVsZHMiOlt7ImlkIjoxLCJuYW1lIjoiYSIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjoibG9uZyJ9LHsiaWQiOjIsIm5hbWUiOiJiIiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJzdHJpbmcifV19ABhKcGFycXVldC1tciB2ZXJzaW9uIDEuMTIuMyAoYnVpbGQgZjhkY2VkMTgyYzRjMWZiZGVjNmNjYjMxODU1MzdiNWEwMWU2ZWQ2YikZLBwAABwAAADPAQAAUEFSMQ== | base64 --decode > /iceberg_data/default/test_delete_files_1_local_cfef13ac_d853_40d3_9aa3_0372c5be3b5c/data/00000-29-56d49e66-a41c-4f64-a499-bc48241928dd-00001.parquet'] (cluster.py:2045, exec_in_container) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command:[docker exec rootteststorageiceberg-gw1-node1-1 bash -c mkdir -p $(dirname /iceberg_data/default/test_delete_files_1_local_cfef13ac_d853_40d3_9aa3_0372c5be3b5c/data/00000-29-56d49e66-a41c-4f64-a499-bc48241928dd-00001.parquet) && echo UEFSMRUAFcAMFfYCFb3z1JUGHBXIARUAFQgVCAAAH4sIAAAAAAAAAC3F1yICAAAAwJBZIVskK7OyM0OK7IzKjvL//+DB3csFAv9a3Oo2B93uDne6y93ucchhR9zrPvc76gEPesjDHvGoxzzumCc86binnPC0ZzzrOc876QUvesnLXvGqU0474zWve8Ob3vK2d5z1rve87wMf+sg5H/vEp877zAUXfe4Ll3zpK1/7xre+873LfvCjn/zsiquu+cWvfvO7P/zpL9f97R833PSv/wACwudxIAMAABUAFaAJFeoCFY28v7gJHBXIARUAFQgVCAAAH4sIAAAAAAAAAB3SsYFCMQxEwQ/XEFiyJPffGOdJXrST7et5nu/rP+smbvJm39RN38zNed/xR7+6NDR1a2nrKLvYxS52sYtd7GIXu9jFBhtssMEGG2ywwQYbbLLJJptssskmm2yyyW52s5vd7GY3u9nNbnazxRZbbLHFFltsscUW22yzzTbbbLPNNttss8MOO+ywww477LDDDnvYwx72sIc97GEPe9hz/nzj8wPU24atUAIAABkRAhkYCAAAAAAAAAAAGRgIYwAAAAAAAAAVAhkWAAAZEQIZGAExGRgCOTkVAhkWAAAZHBYIFaoDFgAAABkcFrIDFZ4DFgAAABUCGTxIBXRhYmxlFQQAFQQlABgBYVUCABUMJQAYAWIlADUEHBwAAAAWyAEZHBksJggcFQQZJQAIGRgBYRUEFsgBFvQMFqoDJgg8GAhjAAAAAAAAABgIAAAAAAAAAAAWACgIYwAAAAAAAAAYCAAAAAAAAAAAABkcFQAVABUCAAAWsgcVFhbQBhU+ACayAxwVDBklAAgZGAFiFQQWyAEW1AkWngMmsgM8NgAoAjk5GAExABkcFQAVABUCAAAWyAcVGBaOBxUkABbIFhbIASYIFsgGFAAAGRwYDmljZWJlcmcuc2NoZW1hGJABeyJ0eXBlIjoic3RydWN0Iiwic2NoZW1hLWlkIjowLCJmaWVsZHMiOlt7ImlkIjoxLCJuYW1lIjoiYSIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjoibG9uZyJ9LHsiaWQiOjIsIm5hbWUiOiJiIiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJzdHJpbmcifV19ABhKcGFycXVldC1tciB2ZXJzaW9uIDEuMTIuMyAoYnVpbGQgZjhkY2VkMTgyYzRjMWZiZGVjNmNjYjMxODU1MzdiNWEwMWU2ZWQ2YikZLBwAABwAAADPAQAAUEFSMQ== | base64 --decode > /iceberg_data/default/test_delete_files_1_local_cfef13ac_d853_40d3_9aa3_0372c5be3b5c/data/00000-29-56d49e66-a41c-4f64-a499-bc48241928dd-00001.parquet] (cluster.py:121, run_and_check) 2025-05-23 21:10:51 [ 671 ] DEBUG : run container_id:rootteststorageiceberg-gw1-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p /iceberg_data/default/test_delete_files_1_local_cfef13ac_d853_40d3_9aa3_0372c5be3b5c/metadata'] (cluster.py:2045, exec_in_container) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command:[docker exec rootteststorageiceberg-gw1-node1-1 bash -c mkdir -p /iceberg_data/default/test_delete_files_1_local_cfef13ac_d853_40d3_9aa3_0372c5be3b5c/metadata] (cluster.py:121, run_and_check) 2025-05-23 21:10:51 [ 671 ] DEBUG : run container_id:rootteststorageiceberg-gw1-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname /iceberg_data/default/test_delete_files_1_local_cfef13ac_d853_40d3_9aa3_0372c5be3b5c/metadata/snap-1160945823172698090-1-0a64394c-d38b-4e0d-a44a-d74e0645dabc.avro) && echo T2JqAQwWYXZyby5zY2hlbWH6G3sidHlwZSI6InJlY29yZCIsIm5hbWUiOiJtYW5pZmVzdF9maWxlIiwiZmllbGRzIjpbeyJuYW1lIjoibWFuaWZlc3RfcGF0aCIsInR5cGUiOiJzdHJpbmciLCJkb2MiOiJMb2NhdGlvbiBVUkkgd2l0aCBGUyBzY2hlbWUiLCJmaWVsZC1pZCI6NTAwfSx7Im5hbWUiOiJtYW5pZmVzdF9sZW5ndGgiLCJ0eXBlIjoibG9uZyIsImRvYyI6IlRvdGFsIGZpbGUgc2l6ZSBpbiBieXRlcyIsImZpZWxkLWlkIjo1MDF9LHsibmFtZSI6InBhcnRpdGlvbl9zcGVjX2lkIiwidHlwZSI6ImludCIsImRvYyI6IlNwZWMgSUQgdXNlZCB0byB3cml0ZSIsImZpZWxkLWlkIjo1MDJ9LHsibmFtZSI6ImFkZGVkX3NuYXBzaG90X2lkIiwidHlwZSI6WyJudWxsIiwibG9uZyJdLCJkb2MiOiJTbmFwc2hvdCBJRCB0aGF0IGFkZGVkIHRoZSBtYW5pZmVzdCIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjo1MDN9LHsibmFtZSI6ImFkZGVkX2RhdGFfZmlsZXNfY291bnQiLCJ0eXBlIjpbIm51bGwiLCJpbnQiXSwiZG9jIjoiQWRkZWQgZW50cnkgY291bnQiLCJkZWZhdWx0IjpudWxsLCJmaWVsZC1pZCI6NTA0fSx7Im5hbWUiOiJleGlzdGluZ19kYXRhX2ZpbGVzX2NvdW50IiwidHlwZSI6WyJudWxsIiwiaW50Il0sImRvYyI6IkV4aXN0aW5nIGVudHJ5IGNvdW50IiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjUwNX0seyJuYW1lIjoiZGVsZXRlZF9kYXRhX2ZpbGVzX2NvdW50IiwidHlwZSI6WyJudWxsIiwiaW50Il0sImRvYyI6IkRlbGV0ZWQgZW50cnkgY291bnQiLCJkZWZhdWx0IjpudWxsLCJmaWVsZC1pZCI6NTA2fSx7Im5hbWUiOiJwYXJ0aXRpb25zIiwidHlwZSI6WyJudWxsIix7InR5cGUiOiJhcnJheSIsIml0ZW1zIjp7InR5cGUiOiJyZWNvcmQiLCJuYW1lIjoicjUwOCIsImZpZWxkcyI6W3sibmFtZSI6ImNvbnRhaW5zX251bGwiLCJ0eXBlIjoiYm9vbGVhbiIsImRvYyI6IlRydWUgaWYgYW55IGZpbGUgaGFzIGEgbnVsbCBwYXJ0aXRpb24gdmFsdWUiLCJmaWVsZC1pZCI6NTA5fSx7Im5hbWUiOiJjb250YWluc19uYW4iLCJ0eXBlIjpbIm51bGwiLCJib29sZWFuIl0sImRvYyI6IlRydWUgaWYgYW55IGZpbGUgaGFzIGEgbmFuIHBhcnRpdGlvbiB2YWx1ZSIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjo1MTh9LHsibmFtZSI6Imxvd2VyX2JvdW5kIiwidHlwZSI6WyJudWxsIiwiYnl0ZXMiXSwiZG9jIjoiUGFydGl0aW9uIGxvd2VyIGJvdW5kIGZvciBhbGwgZmlsZXMiLCJkZWZhdWx0IjpudWxsLCJmaWVsZC1pZCI6NTEwfSx7Im5hbWUiOiJ1cHBlcl9ib3VuZCIsInR5cGUiOlsibnVsbCIsImJ5dGVzIl0sImRvYyI6IlBhcnRpdGlvbiB1cHBlciBib3VuZCBmb3IgYWxsIGZpbGVzIiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjUxMX1dfSwiZWxlbWVudC1pZCI6NTA4fV0sImRvYyI6IlN1bW1hcnkgZm9yIGVhY2ggcGFydGl0aW9uIiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjUwN30seyJuYW1lIjoiYWRkZWRfcm93c19jb3VudCIsInR5cGUiOlsibnVsbCIsImxvbmciXSwiZG9jIjoiQWRkZWQgcm93cyBjb3VudCIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjo1MTJ9LHsibmFtZSI6ImV4aXN0aW5nX3Jvd3NfY291bnQiLCJ0eXBlIjpbIm51bGwiLCJsb25nIl0sImRvYyI6IkV4aXN0aW5nIHJvd3MgY291bnQiLCJkZWZhdWx0IjpudWxsLCJmaWVsZC1pZCI6NTEzfSx7Im5hbWUiOiJkZWxldGVkX3Jvd3NfY291bnQiLCJ0eXBlIjpbIm51bGwiLCJsb25nIl0sImRvYyI6IkRlbGV0ZWQgcm93cyBjb3VudCIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjo1MTR9XX0UYXZyby5jb2RlYw5kZWZsYXRlFnNuYXBzaG90LWlkJjExNjA5NDU4MjMxNzI2OTgwOTAcZm9ybWF0LXZlcnNpb24CMRxpY2ViZXJnLnNjaGVtYbQaeyJ0eXBlIjoic3RydWN0Iiwic2NoZW1hLWlkIjowLCJmaWVsZHMiOlt7ImlkIjo1MDAsIm5hbWUiOiJtYW5pZmVzdF9wYXRoIiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJzdHJpbmciLCJkb2MiOiJMb2NhdGlvbiBVUkkgd2l0aCBGUyBzY2hlbWUifSx7ImlkIjo1MDEsIm5hbWUiOiJtYW5pZmVzdF9sZW5ndGgiLCJyZXF1aXJlZCI6dHJ1ZSwidHlwZSI6ImxvbmciLCJkb2MiOiJUb3RhbCBmaWxlIHNpemUgaW4gYnl0ZXMifSx7ImlkIjo1MDIsIm5hbWUiOiJwYXJ0aXRpb25fc3BlY19pZCIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjoiaW50IiwiZG9jIjoiU3BlYyBJRCB1c2VkIHRvIHdyaXRlIn0seyJpZCI6NTAzLCJuYW1lIjoiYWRkZWRfc25hcHNob3RfaWQiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOiJsb25nIiwiZG9jIjoiU25hcHNob3QgSUQgdGhhdCBhZGRlZCB0aGUgbWFuaWZlc3QifSx7ImlkIjo1MDQsIm5hbWUiOiJhZGRlZF9kYXRhX2ZpbGVzX2NvdW50IiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoiaW50IiwiZG9jIjoiQWRkZWQgZW50cnkgY291bnQifSx7ImlkIjo1MDUsIm5hbWUiOiJleGlzdGluZ19kYXRhX2ZpbGVzX2NvdW50IiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoiaW50IiwiZG9jIjoiRXhpc3RpbmcgZW50cnkgY291bnQifSx7ImlkIjo1MDYsIm5hbWUiOiJkZWxldGVkX2RhdGFfZmlsZXNfY291bnQiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOiJpbnQiLCJkb2MiOiJEZWxldGVkIGVudHJ5IGNvdW50In0seyJpZCI6NTA3LCJuYW1lIjoicGFydGl0aW9ucyIsInJlcXVpcmVkIjpmYWxzZSwidHlwZSI6eyJ0eXBlIjoibGlzdCIsImVsZW1lbnQtaWQiOjUwOCwiZWxlbWVudCI6eyJ0eXBlIjoic3RydWN0IiwiZmllbGRzIjpbeyJpZCI6NTA5LCJuYW1lIjoiY29udGFpbnNfbnVsbCIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjoiYm9vbGVhbiIsImRvYyI6IlRydWUgaWYgYW55IGZpbGUgaGFzIGEgbnVsbCBwYXJ0aXRpb24gdmFsdWUifSx7ImlkIjo1MTgsIm5hbWUiOiJjb250YWluc19uYW4iLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOiJib29sZWFuIiwiZG9jIjoiVHJ1ZSBpZiBhbnkgZmlsZSBoYXMgYSBuYW4gcGFydGl0aW9uIHZhbHVlIn0seyJpZCI6NTEwLCJuYW1lIjoibG93ZXJfYm91bmQiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOiJiaW5hcnkiLCJkb2MiOiJQYXJ0aXRpb24gbG93ZXIgYm91bmQgZm9yIGFsbCBmaWxlcyJ9LHsiaWQiOjUxMSwibmFtZSI6InVwcGVyX2JvdW5kIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoiYmluYXJ5IiwiZG9jIjoiUGFydGl0aW9uIHVwcGVyIGJvdW5kIGZvciBhbGwgZmlsZXMifV19LCJlbGVtZW50LXJlcXVpcmVkIjp0cnVlfSwiZG9jIjoiU3VtbWFyeSBmb3IgZWFjaCBwYXJ0aXRpb24ifSx7ImlkIjo1MTIsIm5hbWUiOiJhZGRlZF9yb3dzX2NvdW50IiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoibG9uZyIsImRvYyI6IkFkZGVkIHJvd3MgY291bnQifSx7ImlkIjo1MTMsIm5hbWUiOiJleGlzdGluZ19yb3dzX2NvdW50IiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoibG9uZyIsImRvYyI6IkV4aXN0aW5nIHJvd3MgY291bnQifSx7ImlkIjo1MTQsIm5hbWUiOiJkZWxldGVkX3Jvd3NfY291bnQiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOiJsb25nIiwiZG9jIjoiRGVsZXRlZCByb3dzIGNvdW50In1dfSRwYXJlbnQtc25hcHNob3QtaWQIbnVsbACfiDvRqBdLO2jVhtP13nWqAqgCHYzJDcIwEACDK6EBE4e1c7TCZ7X2rlEkR5ESQwWUwAvRDD8KoAgK4M0VzWPmNWdV9kG8THtkylSyRDqkXGaZM7IkyYKxTzJjhWkMlDBEiRVQQG4doDUM2BEBGmi2wXkB70I5SKblZ6i20NmgGVqvrRjWZC1pbn5dW8fkgx7Mho7T+N4V6vF5XZ6n23WtlCoW7qu/vp+IO9GoF0s7aNWG0/Xedao= | base64 --decode > /iceberg_data/default/test_delete_files_1_local_cfef13ac_d853_40d3_9aa3_0372c5be3b5c/metadata/snap-1160945823172698090-1-0a64394c-d38b-4e0d-a44a-d74e0645dabc.avro'] (cluster.py:2045, exec_in_container) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command:[docker exec rootteststorageiceberg-gw1-node1-1 bash -c mkdir -p $(dirname /iceberg_data/default/test_delete_files_1_local_cfef13ac_d853_40d3_9aa3_0372c5be3b5c/metadata/snap-1160945823172698090-1-0a64394c-d38b-4e0d-a44a-d74e0645dabc.avro) && echo T2JqAQwWYXZyby5zY2hlbWH6G3sidHlwZSI6InJlY29yZCIsIm5hbWUiOiJtYW5pZmVzdF9maWxlIiwiZmllbGRzIjpbeyJuYW1lIjoibWFuaWZlc3RfcGF0aCIsInR5cGUiOiJzdHJpbmciLCJkb2MiOiJMb2NhdGlvbiBVUkkgd2l0aCBGUyBzY2hlbWUiLCJmaWVsZC1pZCI6NTAwfSx7Im5hbWUiOiJtYW5pZmVzdF9sZW5ndGgiLCJ0eXBlIjoibG9uZyIsImRvYyI6IlRvdGFsIGZpbGUgc2l6ZSBpbiBieXRlcyIsImZpZWxkLWlkIjo1MDF9LHsibmFtZSI6InBhcnRpdGlvbl9zcGVjX2lkIiwidHlwZSI6ImludCIsImRvYyI6IlNwZWMgSUQgdXNlZCB0byB3cml0ZSIsImZpZWxkLWlkIjo1MDJ9LHsibmFtZSI6ImFkZGVkX3NuYXBzaG90X2lkIiwidHlwZSI6WyJudWxsIiwibG9uZyJdLCJkb2MiOiJTbmFwc2hvdCBJRCB0aGF0IGFkZGVkIHRoZSBtYW5pZmVzdCIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjo1MDN9LHsibmFtZSI6ImFkZGVkX2RhdGFfZmlsZXNfY291bnQiLCJ0eXBlIjpbIm51bGwiLCJpbnQiXSwiZG9jIjoiQWRkZWQgZW50cnkgY291bnQiLCJkZWZhdWx0IjpudWxsLCJmaWVsZC1pZCI6NTA0fSx7Im5hbWUiOiJleGlzdGluZ19kYXRhX2ZpbGVzX2NvdW50IiwidHlwZSI6WyJudWxsIiwiaW50Il0sImRvYyI6IkV4aXN0aW5nIGVudHJ5IGNvdW50IiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjUwNX0seyJuYW1lIjoiZGVsZXRlZF9kYXRhX2ZpbGVzX2NvdW50IiwidHlwZSI6WyJudWxsIiwiaW50Il0sImRvYyI6IkRlbGV0ZWQgZW50cnkgY291bnQiLCJkZWZhdWx0IjpudWxsLCJmaWVsZC1pZCI6NTA2fSx7Im5hbWUiOiJwYXJ0aXRpb25zIiwidHlwZSI6WyJudWxsIix7InR5cGUiOiJhcnJheSIsIml0ZW1zIjp7InR5cGUiOiJyZWNvcmQiLCJuYW1lIjoicjUwOCIsImZpZWxkcyI6W3sibmFtZSI6ImNvbnRhaW5zX251bGwiLCJ0eXBlIjoiYm9vbGVhbiIsImRvYyI6IlRydWUgaWYgYW55IGZpbGUgaGFzIGEgbnVsbCBwYXJ0aXRpb24gdmFsdWUiLCJmaWVsZC1pZCI6NTA5fSx7Im5hbWUiOiJjb250YWluc19uYW4iLCJ0eXBlIjpbIm51bGwiLCJib29sZWFuIl0sImRvYyI6IlRydWUgaWYgYW55IGZpbGUgaGFzIGEgbmFuIHBhcnRpdGlvbiB2YWx1ZSIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjo1MTh9LHsibmFtZSI6Imxvd2VyX2JvdW5kIiwidHlwZSI6WyJudWxsIiwiYnl0ZXMiXSwiZG9jIjoiUGFydGl0aW9uIGxvd2VyIGJvdW5kIGZvciBhbGwgZmlsZXMiLCJkZWZhdWx0IjpudWxsLCJmaWVsZC1pZCI6NTEwfSx7Im5hbWUiOiJ1cHBlcl9ib3VuZCIsInR5cGUiOlsibnVsbCIsImJ5dGVzIl0sImRvYyI6IlBhcnRpdGlvbiB1cHBlciBib3VuZCBmb3IgYWxsIGZpbGVzIiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjUxMX1dfSwiZWxlbWVudC1pZCI6NTA4fV0sImRvYyI6IlN1bW1hcnkgZm9yIGVhY2ggcGFydGl0aW9uIiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjUwN30seyJuYW1lIjoiYWRkZWRfcm93c19jb3VudCIsInR5cGUiOlsibnVsbCIsImxvbmciXSwiZG9jIjoiQWRkZWQgcm93cyBjb3VudCIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjo1MTJ9LHsibmFtZSI6ImV4aXN0aW5nX3Jvd3NfY291bnQiLCJ0eXBlIjpbIm51bGwiLCJsb25nIl0sImRvYyI6IkV4aXN0aW5nIHJvd3MgY291bnQiLCJkZWZhdWx0IjpudWxsLCJmaWVsZC1pZCI6NTEzfSx7Im5hbWUiOiJkZWxldGVkX3Jvd3NfY291bnQiLCJ0eXBlIjpbIm51bGwiLCJsb25nIl0sImRvYyI6IkRlbGV0ZWQgcm93cyBjb3VudCIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjo1MTR9XX0UYXZyby5jb2RlYw5kZWZsYXRlFnNuYXBzaG90LWlkJjExNjA5NDU4MjMxNzI2OTgwOTAcZm9ybWF0LXZlcnNpb24CMRxpY2ViZXJnLnNjaGVtYbQaeyJ0eXBlIjoic3RydWN0Iiwic2NoZW1hLWlkIjowLCJmaWVsZHMiOlt7ImlkIjo1MDAsIm5hbWUiOiJtYW5pZmVzdF9wYXRoIiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJzdHJpbmciLCJkb2MiOiJMb2NhdGlvbiBVUkkgd2l0aCBGUyBzY2hlbWUifSx7ImlkIjo1MDEsIm5hbWUiOiJtYW5pZmVzdF9sZW5ndGgiLCJyZXF1aXJlZCI6dHJ1ZSwidHlwZSI6ImxvbmciLCJkb2MiOiJUb3RhbCBmaWxlIHNpemUgaW4gYnl0ZXMifSx7ImlkIjo1MDIsIm5hbWUiOiJwYXJ0aXRpb25fc3BlY19pZCIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjoiaW50IiwiZG9jIjoiU3BlYyBJRCB1c2VkIHRvIHdyaXRlIn0seyJpZCI6NTAzLCJuYW1lIjoiYWRkZWRfc25hcHNob3RfaWQiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOiJsb25nIiwiZG9jIjoiU25hcHNob3QgSUQgdGhhdCBhZGRlZCB0aGUgbWFuaWZlc3QifSx7ImlkIjo1MDQsIm5hbWUiOiJhZGRlZF9kYXRhX2ZpbGVzX2NvdW50IiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoiaW50IiwiZG9jIjoiQWRkZWQgZW50cnkgY291bnQifSx7ImlkIjo1MDUsIm5hbWUiOiJleGlzdGluZ19kYXRhX2ZpbGVzX2NvdW50IiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoiaW50IiwiZG9jIjoiRXhpc3RpbmcgZW50cnkgY291bnQifSx7ImlkIjo1MDYsIm5hbWUiOiJkZWxldGVkX2RhdGFfZmlsZXNfY291bnQiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOiJpbnQiLCJkb2MiOiJEZWxldGVkIGVudHJ5IGNvdW50In0seyJpZCI6NTA3LCJuYW1lIjoicGFydGl0aW9ucyIsInJlcXVpcmVkIjpmYWxzZSwidHlwZSI6eyJ0eXBlIjoibGlzdCIsImVsZW1lbnQtaWQiOjUwOCwiZWxlbWVudCI6eyJ0eXBlIjoic3RydWN0IiwiZmllbGRzIjpbeyJpZCI6NTA5LCJuYW1lIjoiY29udGFpbnNfbnVsbCIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjoiYm9vbGVhbiIsImRvYyI6IlRydWUgaWYgYW55IGZpbGUgaGFzIGEgbnVsbCBwYXJ0aXRpb24gdmFsdWUifSx7ImlkIjo1MTgsIm5hbWUiOiJjb250YWluc19uYW4iLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOiJib29sZWFuIiwiZG9jIjoiVHJ1ZSBpZiBhbnkgZmlsZSBoYXMgYSBuYW4gcGFydGl0aW9uIHZhbHVlIn0seyJpZCI6NTEwLCJuYW1lIjoibG93ZXJfYm91bmQiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOiJiaW5hcnkiLCJkb2MiOiJQYXJ0aXRpb24gbG93ZXIgYm91bmQgZm9yIGFsbCBmaWxlcyJ9LHsiaWQiOjUxMSwibmFtZSI6InVwcGVyX2JvdW5kIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoiYmluYXJ5IiwiZG9jIjoiUGFydGl0aW9uIHVwcGVyIGJvdW5kIGZvciBhbGwgZmlsZXMifV19LCJlbGVtZW50LXJlcXVpcmVkIjp0cnVlfSwiZG9jIjoiU3VtbWFyeSBmb3IgZWFjaCBwYXJ0aXRpb24ifSx7ImlkIjo1MTIsIm5hbWUiOiJhZGRlZF9yb3dzX2NvdW50IiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoibG9uZyIsImRvYyI6IkFkZGVkIHJvd3MgY291bnQifSx7ImlkIjo1MTMsIm5hbWUiOiJleGlzdGluZ19yb3dzX2NvdW50IiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoibG9uZyIsImRvYyI6IkV4aXN0aW5nIHJvd3MgY291bnQifSx7ImlkIjo1MTQsIm5hbWUiOiJkZWxldGVkX3Jvd3NfY291bnQiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOiJsb25nIiwiZG9jIjoiRGVsZXRlZCByb3dzIGNvdW50In1dfSRwYXJlbnQtc25hcHNob3QtaWQIbnVsbACfiDvRqBdLO2jVhtP13nWqAqgCHYzJDcIwEACDK6EBE4e1c7TCZ7X2rlEkR5ESQwWUwAvRDD8KoAgK4M0VzWPmNWdV9kG8THtkylSyRDqkXGaZM7IkyYKxTzJjhWkMlDBEiRVQQG4doDUM2BEBGmi2wXkB70I5SKblZ6i20NmgGVqvrRjWZC1pbn5dW8fkgx7Mho7T+N4V6vF5XZ6n23WtlCoW7qu/vp+IO9GoF0s7aNWG0/Xedao= | base64 --decode > /iceberg_data/default/test_delete_files_1_local_cfef13ac_d853_40d3_9aa3_0372c5be3b5c/metadata/snap-1160945823172698090-1-0a64394c-d38b-4e0d-a44a-d74e0645dabc.avro] (cluster.py:121, run_and_check) 2025-05-23 21:10:51 [ 671 ] DEBUG : run container_id:rootteststorageiceberg-gw1-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p /iceberg_data/default/test_delete_files_1_local_cfef13ac_d853_40d3_9aa3_0372c5be3b5c/metadata'] (cluster.py:2045, exec_in_container) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command:[docker exec rootteststorageiceberg-gw1-node1-1 bash -c mkdir -p /iceberg_data/default/test_delete_files_1_local_cfef13ac_d853_40d3_9aa3_0372c5be3b5c/metadata] (cluster.py:121, run_and_check) 2025-05-23 21:10:51 [ 671 ] DEBUG : run container_id:rootteststorageiceberg-gw1-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname /iceberg_data/default/test_delete_files_1_local_cfef13ac_d853_40d3_9aa3_0372c5be3b5c/metadata/version-hint.text) && echo MQ== | base64 --decode > /iceberg_data/default/test_delete_files_1_local_cfef13ac_d853_40d3_9aa3_0372c5be3b5c/metadata/version-hint.text'] (cluster.py:2045, exec_in_container) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command:[docker exec rootteststorageiceberg-gw1-node1-1 bash -c mkdir -p $(dirname /iceberg_data/default/test_delete_files_1_local_cfef13ac_d853_40d3_9aa3_0372c5be3b5c/metadata/version-hint.text) && echo MQ== | base64 --decode > /iceberg_data/default/test_delete_files_1_local_cfef13ac_d853_40d3_9aa3_0372c5be3b5c/metadata/version-hint.text] (cluster.py:121, run_and_check) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: m d o603 e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: m d o602 e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: m d o463 e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: m d o501 e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: m d o539 e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: m d o608 e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: m d o613 e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: m d o621 e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: m d o627 e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: m d o634 e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: m d o639 e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: m d o606 e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: m d o607 e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: m d o609 e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: m d o610 e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: m d o611 e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: m d o612 e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: m d o614 e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: m d o615 e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: m d o616 e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: m d o617 e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: m d o618 e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: m d o620 e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: m d o622 e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: m d o623 e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: m d o624 e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: m d o625 e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: m d o626 e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: m d o628 e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: m d o629 e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: m d o630 e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: m d o632 e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: m d o633 e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: m d o635 e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: m d o636 e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: m d o637 e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: m d o644 e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command to send: m d o645 e (clientserver.py:501, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:51 [ 671 ] DEBUG : run container_id:rootteststorageiceberg-gw1-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p /iceberg_data/default/test_delete_files_1_local_cfef13ac_d853_40d3_9aa3_0372c5be3b5c/metadata'] (cluster.py:2045, exec_in_container) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command:[docker exec rootteststorageiceberg-gw1-node1-1 bash -c mkdir -p /iceberg_data/default/test_delete_files_1_local_cfef13ac_d853_40d3_9aa3_0372c5be3b5c/metadata] (cluster.py:121, run_and_check) 2025-05-23 21:10:51 [ 671 ] DEBUG : run container_id:rootteststorageiceberg-gw1-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname /iceberg_data/default/test_delete_files_1_local_cfef13ac_d853_40d3_9aa3_0372c5be3b5c/metadata/0a64394c-d38b-4e0d-a44a-d74e0645dabc-m0.avro) && echo T2JqAQ4Mc2NoZW1hpAJ7InR5cGUiOiJzdHJ1Y3QiLCJzY2hlbWEtaWQiOjAsImZpZWxkcyI6W3siaWQiOjEsIm5hbWUiOiJhIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoibG9uZyJ9LHsiaWQiOjIsIm5hbWUiOiJiIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoic3RyaW5nIn1dfRZhdnJvLnNjaGVtYZYueyJ0eXBlIjoicmVjb3JkIiwibmFtZSI6Im1hbmlmZXN0X2VudHJ5IiwiZmllbGRzIjpbeyJuYW1lIjoic3RhdHVzIiwidHlwZSI6ImludCIsImZpZWxkLWlkIjowfSx7Im5hbWUiOiJzbmFwc2hvdF9pZCIsInR5cGUiOlsibnVsbCIsImxvbmciXSwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjF9LHsibmFtZSI6ImRhdGFfZmlsZSIsInR5cGUiOnsidHlwZSI6InJlY29yZCIsIm5hbWUiOiJyMiIsImZpZWxkcyI6W3sibmFtZSI6ImZpbGVfcGF0aCIsInR5cGUiOiJzdHJpbmciLCJkb2MiOiJMb2NhdGlvbiBVUkkgd2l0aCBGUyBzY2hlbWUiLCJmaWVsZC1pZCI6MTAwfSx7Im5hbWUiOiJmaWxlX2Zvcm1hdCIsInR5cGUiOiJzdHJpbmciLCJkb2MiOiJGaWxlIGZvcm1hdCBuYW1lOiBhdnJvLCBvcmMsIG9yIHBhcnF1ZXQiLCJmaWVsZC1pZCI6MTAxfSx7Im5hbWUiOiJwYXJ0aXRpb24iLCJ0eXBlIjp7InR5cGUiOiJyZWNvcmQiLCJuYW1lIjoicjEwMiIsImZpZWxkcyI6W119LCJmaWVsZC1pZCI6MTAyfSx7Im5hbWUiOiJyZWNvcmRfY291bnQiLCJ0eXBlIjoibG9uZyIsImRvYyI6Ik51bWJlciBvZiByZWNvcmRzIGluIHRoZSBmaWxlIiwiZmllbGQtaWQiOjEwM30seyJuYW1lIjoiZmlsZV9zaXplX2luX2J5dGVzIiwidHlwZSI6ImxvbmciLCJkb2MiOiJUb3RhbCBmaWxlIHNpemUgaW4gYnl0ZXMiLCJmaWVsZC1pZCI6MTA0fSx7Im5hbWUiOiJibG9ja19zaXplX2luX2J5dGVzIiwidHlwZSI6ImxvbmciLCJmaWVsZC1pZCI6MTA1fSx7Im5hbWUiOiJjb2x1bW5fc2l6ZXMiLCJ0eXBlIjpbIm51bGwiLHsidHlwZSI6ImFycmF5IiwiaXRlbXMiOnsidHlwZSI6InJlY29yZCIsIm5hbWUiOiJrMTE3X3YxMTgiLCJmaWVsZHMiOlt7Im5hbWUiOiJrZXkiLCJ0eXBlIjoiaW50IiwiZmllbGQtaWQiOjExN30seyJuYW1lIjoidmFsdWUiLCJ0eXBlIjoibG9uZyIsImZpZWxkLWlkIjoxMTh9XX0sImxvZ2ljYWxUeXBlIjoibWFwIn1dLCJkb2MiOiJNYXAgb2YgY29sdW1uIGlkIHRvIHRvdGFsIHNpemUgb24gZGlzayIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjoxMDh9LHsibmFtZSI6InZhbHVlX2NvdW50cyIsInR5cGUiOlsibnVsbCIseyJ0eXBlIjoiYXJyYXkiLCJpdGVtcyI6eyJ0eXBlIjoicmVjb3JkIiwibmFtZSI6ImsxMTlfdjEyMCIsImZpZWxkcyI6W3sibmFtZSI6ImtleSIsInR5cGUiOiJpbnQiLCJmaWVsZC1pZCI6MTE5fSx7Im5hbWUiOiJ2YWx1ZSIsInR5cGUiOiJsb25nIiwiZmllbGQtaWQiOjEyMH1dfSwibG9naWNhbFR5cGUiOiJtYXAifV0sImRvYyI6Ik1hcCBvZiBjb2x1bW4gaWQgdG8gdG90YWwgY291bnQsIGluY2x1ZGluZyBudWxsIGFuZCBOYU4iLCJkZWZhdWx0IjpudWxsLCJmaWVsZC1pZCI6MTA5fSx7Im5hbWUiOiJudWxsX3ZhbHVlX2NvdW50cyIsInR5cGUiOlsibnVsbCIseyJ0eXBlIjoiYXJyYXkiLCJpdGVtcyI6eyJ0eXBlIjoicmVjb3JkIiwibmFtZSI6ImsxMjFfdjEyMiIsImZpZWxkcyI6W3sibmFtZSI6ImtleSIsInR5cGUiOiJpbnQiLCJmaWVsZC1pZCI6MTIxfSx7Im5hbWUiOiJ2YWx1ZSIsInR5cGUiOiJsb25nIiwiZmllbGQtaWQiOjEyMn1dfSwibG9naWNhbFR5cGUiOiJtYXAifV0sImRvYyI6Ik1hcCBvZiBjb2x1bW4gaWQgdG8gbnVsbCB2YWx1ZSBjb3VudCIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjoxMTB9LHsibmFtZSI6Im5hbl92YWx1ZV9jb3VudHMiLCJ0eXBlIjpbIm51bGwiLHsidHlwZSI6ImFycmF5IiwiaXRlbXMiOnsidHlwZSI6InJlY29yZCIsIm5hbWUiOiJrMTM4X3YxMzkiLCJmaWVsZHMiOlt7Im5hbWUiOiJrZXkiLCJ0eXBlIjoiaW50IiwiZmllbGQtaWQiOjEzOH0seyJuYW1lIjoidmFsdWUiLCJ0eXBlIjoibG9uZyIsImZpZWxkLWlkIjoxMzl9XX0sImxvZ2ljYWxUeXBlIjoibWFwIn1dLCJkb2MiOiJNYXAgb2YgY29sdW1uIGlkIHRvIG51bWJlciBvZiBOYU4gdmFsdWVzIGluIHRoZSBjb2x1bW4iLCJkZWZhdWx0IjpudWxsLCJmaWVsZC1pZCI6MTM3fSx7Im5hbWUiOiJsb3dlcl9ib3VuZHMiLCJ0eXBlIjpbIm51bGwiLHsidHlwZSI6ImFycmF5IiwiaXRlbXMiOnsidHlwZSI6InJlY29yZCIsIm5hbWUiOiJrMTI2X3YxMjciLCJmaWVsZHMiOlt7Im5hbWUiOiJrZXkiLCJ0eXBlIjoiaW50IiwiZmllbGQtaWQiOjEyNn0seyJuYW1lIjoidmFsdWUiLCJ0eXBlIjoiYnl0ZXMiLCJmaWVsZC1pZCI6MTI3fV19LCJsb2dpY2FsVHlwZSI6Im1hcCJ9XSwiZG9jIjoiTWFwIG9mIGNvbHVtbiBpZCB0byBsb3dlciBib3VuZCIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjoxMjV9LHsibmFtZSI6InVwcGVyX2JvdW5kcyIsInR5cGUiOlsibnVsbCIseyJ0eXBlIjoiYXJyYXkiLCJpdGVtcyI6eyJ0eXBlIjoicmVjb3JkIiwibmFtZSI6ImsxMjlfdjEzMCIsImZpZWxkcyI6W3sibmFtZSI6ImtleSIsInR5cGUiOiJpbnQiLCJmaWVsZC1pZCI6MTI5fSx7Im5hbWUiOiJ2YWx1ZSIsInR5cGUiOiJieXRlcyIsImZpZWxkLWlkIjoxMzB9XX0sImxvZ2ljYWxUeXBlIjoibWFwIn1dLCJkb2MiOiJNYXAgb2YgY29sdW1uIGlkIHRvIHVwcGVyIGJvdW5kIiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjEyOH0seyJuYW1lIjoia2V5X21ldGFkYXRhIiwidHlwZSI6WyJudWxsIiwiYnl0ZXMiXSwiZG9jIjoiRW5jcnlwdGlvbiBrZXkgbWV0YWRhdGEgYmxvYiIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjoxMzF9LHsibmFtZSI6InNwbGl0X29mZnNldHMiLCJ0eXBlIjpbIm51bGwiLHsidHlwZSI6ImFycmF5IiwiaXRlbXMiOiJsb25nIiwiZWxlbWVudC1pZCI6MTMzfV0sImRvYyI6IlNwbGl0dGFibGUgb2Zmc2V0cyIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjoxMzJ9LHsibmFtZSI6InNvcnRfb3JkZXJfaWQiLCJ0eXBlIjpbIm51bGwiLCJpbnQiXSwiZG9jIjoiU29ydCBvcmRlciBJRCIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjoxNDB9XX0sImZpZWxkLWlkIjoyfV19FGF2cm8uY29kZWMOZGVmbGF0ZRxmb3JtYXQtdmVyc2lvbgIxInBhcnRpdGlvbi1zcGVjLWlkAjAcaWNlYmVyZy5zY2hlbWHqJHsidHlwZSI6InN0cnVjdCIsInNjaGVtYS1pZCI6MCwiZmllbGRzIjpbeyJpZCI6MCwibmFtZSI6InN0YXR1cyIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjoiaW50In0seyJpZCI6MSwibmFtZSI6InNuYXBzaG90X2lkIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoibG9uZyJ9LHsiaWQiOjIsIm5hbWUiOiJkYXRhX2ZpbGUiLCJyZXF1aXJlZCI6dHJ1ZSwidHlwZSI6eyJ0eXBlIjoic3RydWN0IiwiZmllbGRzIjpbeyJpZCI6MTAwLCJuYW1lIjoiZmlsZV9wYXRoIiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJzdHJpbmciLCJkb2MiOiJMb2NhdGlvbiBVUkkgd2l0aCBGUyBzY2hlbWUifSx7ImlkIjoxMDEsIm5hbWUiOiJmaWxlX2Zvcm1hdCIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjoic3RyaW5nIiwiZG9jIjoiRmlsZSBmb3JtYXQgbmFtZTogYXZybywgb3JjLCBvciBwYXJxdWV0In0seyJpZCI6MTAyLCJuYW1lIjoicGFydGl0aW9uIiwicmVxdWlyZWQiOnRydWUsInR5cGUiOnsidHlwZSI6InN0cnVjdCIsImZpZWxkcyI6W119fSx7ImlkIjoxMDMsIm5hbWUiOiJyZWNvcmRfY291bnQiLCJyZXF1aXJlZCI6dHJ1ZSwidHlwZSI6ImxvbmciLCJkb2MiOiJOdW1iZXIgb2YgcmVjb3JkcyBpbiB0aGUgZmlsZSJ9LHsiaWQiOjEwNCwibmFtZSI6ImZpbGVfc2l6ZV9pbl9ieXRlcyIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjoibG9uZyIsImRvYyI6IlRvdGFsIGZpbGUgc2l6ZSBpbiBieXRlcyJ9LHsiaWQiOjEwNSwibmFtZSI6ImJsb2NrX3NpemVfaW5fYnl0ZXMiLCJyZXF1aXJlZCI6dHJ1ZSwidHlwZSI6ImxvbmcifSx7ImlkIjoxMDgsIm5hbWUiOiJjb2x1bW5fc2l6ZXMiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOnsidHlwZSI6Im1hcCIsImtleS1pZCI6MTE3LCJrZXkiOiJpbnQiLCJ2YWx1ZS1pZCI6MTE4LCJ2YWx1ZSI6ImxvbmciLCJ2YWx1ZS1yZXF1aXJlZCI6dHJ1ZX0sImRvYyI6Ik1hcCBvZiBjb2x1bW4gaWQgdG8gdG90YWwgc2l6ZSBvbiBkaXNrIn0seyJpZCI6MTA5LCJuYW1lIjoidmFsdWVfY291bnRzIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjp7InR5cGUiOiJtYXAiLCJrZXktaWQiOjExOSwia2V5IjoiaW50IiwidmFsdWUtaWQiOjEyMCwidmFsdWUiOiJsb25nIiwidmFsdWUtcmVxdWlyZWQiOnRydWV9LCJkb2MiOiJNYXAgb2YgY29sdW1uIGlkIHRvIHRvdGFsIGNvdW50LCBpbmNsdWRpbmcgbnVsbCBhbmQgTmFOIn0seyJpZCI6MTEwLCJuYW1lIjoibnVsbF92YWx1ZV9jb3VudHMiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOnsidHlwZSI6Im1hcCIsImtleS1pZCI6MTIxLCJrZXkiOiJpbnQiLCJ2YWx1ZS1pZCI6MTIyLCJ2YWx1ZSI6ImxvbmciLCJ2YWx1ZS1yZXF1aXJlZCI6dHJ1ZX0sImRvYyI6Ik1hcCBvZiBjb2x1bW4gaWQgdG8gbnVsbCB2YWx1ZSBjb3VudCJ9LHsiaWQiOjEzNywibmFtZSI6Im5hbl92YWx1ZV9jb3VudHMiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOnsidHlwZSI6Im1hcCIsImtleS1pZCI6MTM4LCJrZXkiOiJpbnQiLCJ2YWx1ZS1pZCI6MTM5LCJ2YWx1ZSI6ImxvbmciLCJ2YWx1ZS1yZXF1aXJlZCI6dHJ1ZX0sImRvYyI6Ik1hcCBvZiBjb2x1bW4gaWQgdG8gbnVtYmVyIG9mIE5hTiB2YWx1ZXMgaW4gdGhlIGNvbHVtbiJ9LHsiaWQiOjEyNSwibmFtZSI6Imxvd2VyX2JvdW5kcyIsInJlcXVpcmVkIjpmYWxzZSwidHlwZSI6eyJ0eXBlIjoibWFwIiwia2V5LWlkIjoxMjYsImtleSI6ImludCIsInZhbHVlLWlkIjoxMjcsInZhbHVlIjoiYmluYXJ5IiwidmFsdWUtcmVxdWlyZWQiOnRydWV9LCJkb2MiOiJNYXAgb2YgY29sdW1uIGlkIHRvIGxvd2VyIGJvdW5kIn0seyJpZCI6MTI4LCJuYW1lIjoidXBwZXJfYm91bmRzIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjp7InR5cGUiOiJtYXAiLCJrZXktaWQiOjEyOSwia2V5IjoiaW50IiwidmFsdWUtaWQiOjEzMCwidmFsdWUiOiJiaW5hcnkiLCJ2YWx1ZS1yZXF1aXJlZCI6dHJ1ZX0sImRvYyI6Ik1hcCBvZiBjb2x1bW4gaWQgdG8gdXBwZXIgYm91bmQifSx7ImlkIjoxMzEsIm5hbWUiOiJrZXlfbWV0YWRhdGEiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOiJiaW5hcnkiLCJkb2MiOiJFbmNyeXB0aW9uIGtleSBtZXRhZGF0YSBibG9iIn0seyJpZCI6MTMyLCJuYW1lIjoic3BsaXRfb2Zmc2V0cyIsInJlcXVpcmVkIjpmYWxzZSwidHlwZSI6eyJ0eXBlIjoibGlzdCIsImVsZW1lbnQtaWQiOjEzMywiZWxlbWVudCI6ImxvbmciLCJlbGVtZW50LXJlcXVpcmVkIjp0cnVlfSwiZG9jIjoiU3BsaXR0YWJsZSBvZmZzZXRzIn0seyJpZCI6MTQwLCJuYW1lIjoic29ydF9vcmRlcl9pZCIsInJlcXVpcmVkIjpmYWxzZSwidHlwZSI6ImludCIsImRvYyI6IlNvcnQgb3JkZXIgSUQifV19fV19HHBhcnRpdGlvbi1zcGVjBFtdABM+5xcrWk9eqd6HISPz8ckCpAM1jDFOxDAQRR2vCyrYI3ABkzh2QtxBQQ8I6tFkPEYrWVrY9fYpqDkAQhxgb0GXA3AIDkAPyQpe9b709KX8/Pl+/Xr+eDvdy3JF3PPmAQJmLANH3KVcZt5mCJw4M8RV4i0YSGvCBBQ5GosEoWssuCpY8IgWKnteU9Oz7RsqD1/VjK69btrgPLetRmdIu9i6ybzXPbmudsbXXQh6js3ZI26edpyPry9vb+6v7sbi5WQYhgup5H6h3hdikrFQYzGLUELIWZbiDyXNYdP/Vt5PjTyaul8TPucXK1pPXqnehyEj8/HJ | base64 --decode > /iceberg_data/default/test_delete_files_1_local_cfef13ac_d853_40d3_9aa3_0372c5be3b5c/metadata/0a64394c-d38b-4e0d-a44a-d74e0645dabc-m0.avro'] (cluster.py:2045, exec_in_container) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command:[docker exec rootteststorageiceberg-gw1-node1-1 bash -c mkdir -p $(dirname /iceberg_data/default/test_delete_files_1_local_cfef13ac_d853_40d3_9aa3_0372c5be3b5c/metadata/0a64394c-d38b-4e0d-a44a-d74e0645dabc-m0.avro) && echo T2JqAQ4Mc2NoZW1hpAJ7InR5cGUiOiJzdHJ1Y3QiLCJzY2hlbWEtaWQiOjAsImZpZWxkcyI6W3siaWQiOjEsIm5hbWUiOiJhIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoibG9uZyJ9LHsiaWQiOjIsIm5hbWUiOiJiIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoic3RyaW5nIn1dfRZhdnJvLnNjaGVtYZYueyJ0eXBlIjoicmVjb3JkIiwibmFtZSI6Im1hbmlmZXN0X2VudHJ5IiwiZmllbGRzIjpbeyJuYW1lIjoic3RhdHVzIiwidHlwZSI6ImludCIsImZpZWxkLWlkIjowfSx7Im5hbWUiOiJzbmFwc2hvdF9pZCIsInR5cGUiOlsibnVsbCIsImxvbmciXSwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjF9LHsibmFtZSI6ImRhdGFfZmlsZSIsInR5cGUiOnsidHlwZSI6InJlY29yZCIsIm5hbWUiOiJyMiIsImZpZWxkcyI6W3sibmFtZSI6ImZpbGVfcGF0aCIsInR5cGUiOiJzdHJpbmciLCJkb2MiOiJMb2NhdGlvbiBVUkkgd2l0aCBGUyBzY2hlbWUiLCJmaWVsZC1pZCI6MTAwfSx7Im5hbWUiOiJmaWxlX2Zvcm1hdCIsInR5cGUiOiJzdHJpbmciLCJkb2MiOiJGaWxlIGZvcm1hdCBuYW1lOiBhdnJvLCBvcmMsIG9yIHBhcnF1ZXQiLCJmaWVsZC1pZCI6MTAxfSx7Im5hbWUiOiJwYXJ0aXRpb24iLCJ0eXBlIjp7InR5cGUiOiJyZWNvcmQiLCJuYW1lIjoicjEwMiIsImZpZWxkcyI6W119LCJmaWVsZC1pZCI6MTAyfSx7Im5hbWUiOiJyZWNvcmRfY291bnQiLCJ0eXBlIjoibG9uZyIsImRvYyI6Ik51bWJlciBvZiByZWNvcmRzIGluIHRoZSBmaWxlIiwiZmllbGQtaWQiOjEwM30seyJuYW1lIjoiZmlsZV9zaXplX2luX2J5dGVzIiwidHlwZSI6ImxvbmciLCJkb2MiOiJUb3RhbCBmaWxlIHNpemUgaW4gYnl0ZXMiLCJmaWVsZC1pZCI6MTA0fSx7Im5hbWUiOiJibG9ja19zaXplX2luX2J5dGVzIiwidHlwZSI6ImxvbmciLCJmaWVsZC1pZCI6MTA1fSx7Im5hbWUiOiJjb2x1bW5fc2l6ZXMiLCJ0eXBlIjpbIm51bGwiLHsidHlwZSI6ImFycmF5IiwiaXRlbXMiOnsidHlwZSI6InJlY29yZCIsIm5hbWUiOiJrMTE3X3YxMTgiLCJmaWVsZHMiOlt7Im5hbWUiOiJrZXkiLCJ0eXBlIjoiaW50IiwiZmllbGQtaWQiOjExN30seyJuYW1lIjoidmFsdWUiLCJ0eXBlIjoibG9uZyIsImZpZWxkLWlkIjoxMTh9XX0sImxvZ2ljYWxUeXBlIjoibWFwIn1dLCJkb2MiOiJNYXAgb2YgY29sdW1uIGlkIHRvIHRvdGFsIHNpemUgb24gZGlzayIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjoxMDh9LHsibmFtZSI6InZhbHVlX2NvdW50cyIsInR5cGUiOlsibnVsbCIseyJ0eXBlIjoiYXJyYXkiLCJpdGVtcyI6eyJ0eXBlIjoicmVjb3JkIiwibmFtZSI6ImsxMTlfdjEyMCIsImZpZWxkcyI6W3sibmFtZSI6ImtleSIsInR5cGUiOiJpbnQiLCJmaWVsZC1pZCI6MTE5fSx7Im5hbWUiOiJ2YWx1ZSIsInR5cGUiOiJsb25nIiwiZmllbGQtaWQiOjEyMH1dfSwibG9naWNhbFR5cGUiOiJtYXAifV0sImRvYyI6Ik1hcCBvZiBjb2x1bW4gaWQgdG8gdG90YWwgY291bnQsIGluY2x1ZGluZyBudWxsIGFuZCBOYU4iLCJkZWZhdWx0IjpudWxsLCJmaWVsZC1pZCI6MTA5fSx7Im5hbWUiOiJudWxsX3ZhbHVlX2NvdW50cyIsInR5cGUiOlsibnVsbCIseyJ0eXBlIjoiYXJyYXkiLCJpdGVtcyI6eyJ0eXBlIjoicmVjb3JkIiwibmFtZSI6ImsxMjFfdjEyMiIsImZpZWxkcyI6W3sibmFtZSI6ImtleSIsInR5cGUiOiJpbnQiLCJmaWVsZC1pZCI6MTIxfSx7Im5hbWUiOiJ2YWx1ZSIsInR5cGUiOiJsb25nIiwiZmllbGQtaWQiOjEyMn1dfSwibG9naWNhbFR5cGUiOiJtYXAifV0sImRvYyI6Ik1hcCBvZiBjb2x1bW4gaWQgdG8gbnVsbCB2YWx1ZSBjb3VudCIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjoxMTB9LHsibmFtZSI6Im5hbl92YWx1ZV9jb3VudHMiLCJ0eXBlIjpbIm51bGwiLHsidHlwZSI6ImFycmF5IiwiaXRlbXMiOnsidHlwZSI6InJlY29yZCIsIm5hbWUiOiJrMTM4X3YxMzkiLCJmaWVsZHMiOlt7Im5hbWUiOiJrZXkiLCJ0eXBlIjoiaW50IiwiZmllbGQtaWQiOjEzOH0seyJuYW1lIjoidmFsdWUiLCJ0eXBlIjoibG9uZyIsImZpZWxkLWlkIjoxMzl9XX0sImxvZ2ljYWxUeXBlIjoibWFwIn1dLCJkb2MiOiJNYXAgb2YgY29sdW1uIGlkIHRvIG51bWJlciBvZiBOYU4gdmFsdWVzIGluIHRoZSBjb2x1bW4iLCJkZWZhdWx0IjpudWxsLCJmaWVsZC1pZCI6MTM3fSx7Im5hbWUiOiJsb3dlcl9ib3VuZHMiLCJ0eXBlIjpbIm51bGwiLHsidHlwZSI6ImFycmF5IiwiaXRlbXMiOnsidHlwZSI6InJlY29yZCIsIm5hbWUiOiJrMTI2X3YxMjciLCJmaWVsZHMiOlt7Im5hbWUiOiJrZXkiLCJ0eXBlIjoiaW50IiwiZmllbGQtaWQiOjEyNn0seyJuYW1lIjoidmFsdWUiLCJ0eXBlIjoiYnl0ZXMiLCJmaWVsZC1pZCI6MTI3fV19LCJsb2dpY2FsVHlwZSI6Im1hcCJ9XSwiZG9jIjoiTWFwIG9mIGNvbHVtbiBpZCB0byBsb3dlciBib3VuZCIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjoxMjV9LHsibmFtZSI6InVwcGVyX2JvdW5kcyIsInR5cGUiOlsibnVsbCIseyJ0eXBlIjoiYXJyYXkiLCJpdGVtcyI6eyJ0eXBlIjoicmVjb3JkIiwibmFtZSI6ImsxMjlfdjEzMCIsImZpZWxkcyI6W3sibmFtZSI6ImtleSIsInR5cGUiOiJpbnQiLCJmaWVsZC1pZCI6MTI5fSx7Im5hbWUiOiJ2YWx1ZSIsInR5cGUiOiJieXRlcyIsImZpZWxkLWlkIjoxMzB9XX0sImxvZ2ljYWxUeXBlIjoibWFwIn1dLCJkb2MiOiJNYXAgb2YgY29sdW1uIGlkIHRvIHVwcGVyIGJvdW5kIiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjEyOH0seyJuYW1lIjoia2V5X21ldGFkYXRhIiwidHlwZSI6WyJudWxsIiwiYnl0ZXMiXSwiZG9jIjoiRW5jcnlwdGlvbiBrZXkgbWV0YWRhdGEgYmxvYiIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjoxMzF9LHsibmFtZSI6InNwbGl0X29mZnNldHMiLCJ0eXBlIjpbIm51bGwiLHsidHlwZSI6ImFycmF5IiwiaXRlbXMiOiJsb25nIiwiZWxlbWVudC1pZCI6MTMzfV0sImRvYyI6IlNwbGl0dGFibGUgb2Zmc2V0cyIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjoxMzJ9LHsibmFtZSI6InNvcnRfb3JkZXJfaWQiLCJ0eXBlIjpbIm51bGwiLCJpbnQiXSwiZG9jIjoiU29ydCBvcmRlciBJRCIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjoxNDB9XX0sImZpZWxkLWlkIjoyfV19FGF2cm8uY29kZWMOZGVmbGF0ZRxmb3JtYXQtdmVyc2lvbgIxInBhcnRpdGlvbi1zcGVjLWlkAjAcaWNlYmVyZy5zY2hlbWHqJHsidHlwZSI6InN0cnVjdCIsInNjaGVtYS1pZCI6MCwiZmllbGRzIjpbeyJpZCI6MCwibmFtZSI6InN0YXR1cyIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjoiaW50In0seyJpZCI6MSwibmFtZSI6InNuYXBzaG90X2lkIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoibG9uZyJ9LHsiaWQiOjIsIm5hbWUiOiJkYXRhX2ZpbGUiLCJyZXF1aXJlZCI6dHJ1ZSwidHlwZSI6eyJ0eXBlIjoic3RydWN0IiwiZmllbGRzIjpbeyJpZCI6MTAwLCJuYW1lIjoiZmlsZV9wYXRoIiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJzdHJpbmciLCJkb2MiOiJMb2NhdGlvbiBVUkkgd2l0aCBGUyBzY2hlbWUifSx7ImlkIjoxMDEsIm5hbWUiOiJmaWxlX2Zvcm1hdCIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjoic3RyaW5nIiwiZG9jIjoiRmlsZSBmb3JtYXQgbmFtZTogYXZybywgb3JjLCBvciBwYXJxdWV0In0seyJpZCI6MTAyLCJuYW1lIjoicGFydGl0aW9uIiwicmVxdWlyZWQiOnRydWUsInR5cGUiOnsidHlwZSI6InN0cnVjdCIsImZpZWxkcyI6W119fSx7ImlkIjoxMDMsIm5hbWUiOiJyZWNvcmRfY291bnQiLCJyZXF1aXJlZCI6dHJ1ZSwidHlwZSI6ImxvbmciLCJkb2MiOiJOdW1iZXIgb2YgcmVjb3JkcyBpbiB0aGUgZmlsZSJ9LHsiaWQiOjEwNCwibmFtZSI6ImZpbGVfc2l6ZV9pbl9ieXRlcyIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjoibG9uZyIsImRvYyI6IlRvdGFsIGZpbGUgc2l6ZSBpbiBieXRlcyJ9LHsiaWQiOjEwNSwibmFtZSI6ImJsb2NrX3NpemVfaW5fYnl0ZXMiLCJyZXF1aXJlZCI6dHJ1ZSwidHlwZSI6ImxvbmcifSx7ImlkIjoxMDgsIm5hbWUiOiJjb2x1bW5fc2l6ZXMiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOnsidHlwZSI6Im1hcCIsImtleS1pZCI6MTE3LCJrZXkiOiJpbnQiLCJ2YWx1ZS1pZCI6MTE4LCJ2YWx1ZSI6ImxvbmciLCJ2YWx1ZS1yZXF1aXJlZCI6dHJ1ZX0sImRvYyI6Ik1hcCBvZiBjb2x1bW4gaWQgdG8gdG90YWwgc2l6ZSBvbiBkaXNrIn0seyJpZCI6MTA5LCJuYW1lIjoidmFsdWVfY291bnRzIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjp7InR5cGUiOiJtYXAiLCJrZXktaWQiOjExOSwia2V5IjoiaW50IiwidmFsdWUtaWQiOjEyMCwidmFsdWUiOiJsb25nIiwidmFsdWUtcmVxdWlyZWQiOnRydWV9LCJkb2MiOiJNYXAgb2YgY29sdW1uIGlkIHRvIHRvdGFsIGNvdW50LCBpbmNsdWRpbmcgbnVsbCBhbmQgTmFOIn0seyJpZCI6MTEwLCJuYW1lIjoibnVsbF92YWx1ZV9jb3VudHMiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOnsidHlwZSI6Im1hcCIsImtleS1pZCI6MTIxLCJrZXkiOiJpbnQiLCJ2YWx1ZS1pZCI6MTIyLCJ2YWx1ZSI6ImxvbmciLCJ2YWx1ZS1yZXF1aXJlZCI6dHJ1ZX0sImRvYyI6Ik1hcCBvZiBjb2x1bW4gaWQgdG8gbnVsbCB2YWx1ZSBjb3VudCJ9LHsiaWQiOjEzNywibmFtZSI6Im5hbl92YWx1ZV9jb3VudHMiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOnsidHlwZSI6Im1hcCIsImtleS1pZCI6MTM4LCJrZXkiOiJpbnQiLCJ2YWx1ZS1pZCI6MTM5LCJ2YWx1ZSI6ImxvbmciLCJ2YWx1ZS1yZXF1aXJlZCI6dHJ1ZX0sImRvYyI6Ik1hcCBvZiBjb2x1bW4gaWQgdG8gbnVtYmVyIG9mIE5hTiB2YWx1ZXMgaW4gdGhlIGNvbHVtbiJ9LHsiaWQiOjEyNSwibmFtZSI6Imxvd2VyX2JvdW5kcyIsInJlcXVpcmVkIjpmYWxzZSwidHlwZSI6eyJ0eXBlIjoibWFwIiwia2V5LWlkIjoxMjYsImtleSI6ImludCIsInZhbHVlLWlkIjoxMjcsInZhbHVlIjoiYmluYXJ5IiwidmFsdWUtcmVxdWlyZWQiOnRydWV9LCJkb2MiOiJNYXAgb2YgY29sdW1uIGlkIHRvIGxvd2VyIGJvdW5kIn0seyJpZCI6MTI4LCJuYW1lIjoidXBwZXJfYm91bmRzIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjp7InR5cGUiOiJtYXAiLCJrZXktaWQiOjEyOSwia2V5IjoiaW50IiwidmFsdWUtaWQiOjEzMCwidmFsdWUiOiJiaW5hcnkiLCJ2YWx1ZS1yZXF1aXJlZCI6dHJ1ZX0sImRvYyI6Ik1hcCBvZiBjb2x1bW4gaWQgdG8gdXBwZXIgYm91bmQifSx7ImlkIjoxMzEsIm5hbWUiOiJrZXlfbWV0YWRhdGEiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOiJiaW5hcnkiLCJkb2MiOiJFbmNyeXB0aW9uIGtleSBtZXRhZGF0YSBibG9iIn0seyJpZCI6MTMyLCJuYW1lIjoic3BsaXRfb2Zmc2V0cyIsInJlcXVpcmVkIjpmYWxzZSwidHlwZSI6eyJ0eXBlIjoibGlzdCIsImVsZW1lbnQtaWQiOjEzMywiZWxlbWVudCI6ImxvbmciLCJlbGVtZW50LXJlcXVpcmVkIjp0cnVlfSwiZG9jIjoiU3BsaXR0YWJsZSBvZmZzZXRzIn0seyJpZCI6MTQwLCJuYW1lIjoic29ydF9vcmRlcl9pZCIsInJlcXVpcmVkIjpmYWxzZSwidHlwZSI6ImludCIsImRvYyI6IlNvcnQgb3JkZXIgSUQifV19fV19HHBhcnRpdGlvbi1zcGVjBFtdABM+5xcrWk9eqd6HISPz8ckCpAM1jDFOxDAQRR2vCyrYI3ABkzh2QtxBQQ8I6tFkPEYrWVrY9fYpqDkAQhxgb0GXA3AIDkAPyQpe9b709KX8/Pl+/Xr+eDvdy3JF3PPmAQJmLANH3KVcZt5mCJw4M8RV4i0YSGvCBBQ5GosEoWssuCpY8IgWKnteU9Oz7RsqD1/VjK69btrgPLetRmdIu9i6ybzXPbmudsbXXQh6js3ZI26edpyPry9vb+6v7sbi5WQYhgup5H6h3hdikrFQYzGLUELIWZbiDyXNYdP/Vt5PjTyaul8TPucXK1pPXqnehyEj8/HJ | base64 --decode > /iceberg_data/default/test_delete_files_1_local_cfef13ac_d853_40d3_9aa3_0372c5be3b5c/metadata/0a64394c-d38b-4e0d-a44a-d74e0645dabc-m0.avro] (cluster.py:121, run_and_check) 2025-05-23 21:10:51 [ 671 ] DEBUG : run container_id:rootteststorageiceberg-gw1-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p /iceberg_data/default/test_delete_files_1_local_cfef13ac_d853_40d3_9aa3_0372c5be3b5c/metadata'] (cluster.py:2045, exec_in_container) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command:[docker exec rootteststorageiceberg-gw1-node1-1 bash -c mkdir -p /iceberg_data/default/test_delete_files_1_local_cfef13ac_d853_40d3_9aa3_0372c5be3b5c/metadata] (cluster.py:121, run_and_check) 2025-05-23 21:10:51 [ 671 ] DEBUG : run container_id:rootteststorageiceberg-gw1-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname /iceberg_data/default/test_delete_files_1_local_cfef13ac_d853_40d3_9aa3_0372c5be3b5c/metadata/v1.metadata.json) && echo ewogICJmb3JtYXQtdmVyc2lvbiIgOiAxLAogICJ0YWJsZS11dWlkIiA6ICJlMjE0NTY3Ni00ZTkzLTRlMzQtOGU4Ni1kMzcwZWU0MDMzNTQiLAogICJsb2NhdGlvbiIgOiAiL2ljZWJlcmdfZGF0YS9kZWZhdWx0L3Rlc3RfZGVsZXRlX2ZpbGVzXzFfbG9jYWxfY2ZlZjEzYWNfZDg1M180MGQzXzlhYTNfMDM3MmM1YmUzYjVjIiwKICAibGFzdC11cGRhdGVkLW1zIiA6IDE3NDgwMzQ2NTExODUsCiAgImxhc3QtY29sdW1uLWlkIiA6IDIsCiAgInNjaGVtYSIgOiB7CiAgICAidHlwZSIgOiAic3RydWN0IiwKICAgICJzY2hlbWEtaWQiIDogMCwKICAgICJmaWVsZHMiIDogWyB7CiAgICAgICJpZCIgOiAxLAogICAgICAibmFtZSIgOiAiYSIsCiAgICAgICJyZXF1aXJlZCIgOiBmYWxzZSwKICAgICAgInR5cGUiIDogImxvbmciCiAgICB9LCB7CiAgICAgICJpZCIgOiAyLAogICAgICAibmFtZSIgOiAiYiIsCiAgICAgICJyZXF1aXJlZCIgOiBmYWxzZSwKICAgICAgInR5cGUiIDogInN0cmluZyIKICAgIH0gXQogIH0sCiAgImN1cnJlbnQtc2NoZW1hLWlkIiA6IDAsCiAgInNjaGVtYXMiIDogWyB7CiAgICAidHlwZSIgOiAic3RydWN0IiwKICAgICJzY2hlbWEtaWQiIDogMCwKICAgICJmaWVsZHMiIDogWyB7CiAgICAgICJpZCIgOiAxLAogICAgICAibmFtZSIgOiAiYSIsCiAgICAgICJyZXF1aXJlZCIgOiBmYWxzZSwKICAgICAgInR5cGUiIDogImxvbmciCiAgICB9LCB7CiAgICAgICJpZCIgOiAyLAogICAgICAibmFtZSIgOiAiYiIsCiAgICAgICJyZXF1aXJlZCIgOiBmYWxzZSwKICAgICAgInR5cGUiIDogInN0cmluZyIKICAgIH0gXQogIH0gXSwKICAicGFydGl0aW9uLXNwZWMiIDogWyBdLAogICJkZWZhdWx0LXNwZWMtaWQiIDogMCwKICAicGFydGl0aW9uLXNwZWNzIiA6IFsgewogICAgInNwZWMtaWQiIDogMCwKICAgICJmaWVsZHMiIDogWyBdCiAgfSBdLAogICJsYXN0LXBhcnRpdGlvbi1pZCIgOiA5OTksCiAgImRlZmF1bHQtc29ydC1vcmRlci1pZCIgOiAwLAogICJzb3J0LW9yZGVycyIgOiBbIHsKICAgICJvcmRlci1pZCIgOiAwLAogICAgImZpZWxkcyIgOiBbIF0KICB9IF0sCiAgInByb3BlcnRpZXMiIDogewogICAgIm93bmVyIiA6ICJyb290IgogIH0sCiAgImN1cnJlbnQtc25hcHNob3QtaWQiIDogMTE2MDk0NTgyMzE3MjY5ODA5MCwKICAicmVmcyIgOiB7CiAgICAibWFpbiIgOiB7CiAgICAgICJzbmFwc2hvdC1pZCIgOiAxMTYwOTQ1ODIzMTcyNjk4MDkwLAogICAgICAidHlwZSIgOiAiYnJhbmNoIgogICAgfQogIH0sCiAgInNuYXBzaG90cyIgOiBbIHsKICAgICJzbmFwc2hvdC1pZCIgOiAxMTYwOTQ1ODIzMTcyNjk4MDkwLAogICAgInRpbWVzdGFtcC1tcyIgOiAxNzQ4MDM0NjUxMTg1LAogICAgInN1bW1hcnkiIDogewogICAgICAib3BlcmF0aW9uIiA6ICJhcHBlbmQiLAogICAgICAic3BhcmsuYXBwLmlkIiA6ICJsb2NhbC0xNzQ4MDM0NjM2NDMyIiwKICAgICAgImFkZGVkLWRhdGEtZmlsZXMiIDogIjEiLAogICAgICAiYWRkZWQtcmVjb3JkcyIgOiAiMTAwIiwKICAgICAgImFkZGVkLWZpbGVzLXNpemUiIDogIjk2NyIsCiAgICAgICJjaGFuZ2VkLXBhcnRpdGlvbi1jb3VudCIgOiAiMSIsCiAgICAgICJ0b3RhbC1yZWNvcmRzIiA6ICIxMDAiLAogICAgICAidG90YWwtZmlsZXMtc2l6ZSIgOiAiOTY3IiwKICAgICAgInRvdGFsLWRhdGEtZmlsZXMiIDogIjEiLAogICAgICAidG90YWwtZGVsZXRlLWZpbGVzIiA6ICIwIiwKICAgICAgInRvdGFsLXBvc2l0aW9uLWRlbGV0ZXMiIDogIjAiLAogICAgICAidG90YWwtZXF1YWxpdHktZGVsZXRlcyIgOiAiMCIKICAgIH0sCiAgICAibWFuaWZlc3QtbGlzdCIgOiAiL2ljZWJlcmdfZGF0YS9kZWZhdWx0L3Rlc3RfZGVsZXRlX2ZpbGVzXzFfbG9jYWxfY2ZlZjEzYWNfZDg1M180MGQzXzlhYTNfMDM3MmM1YmUzYjVjL21ldGFkYXRhL3NuYXAtMTE2MDk0NTgyMzE3MjY5ODA5MC0xLTBhNjQzOTRjLWQzOGItNGUwZC1hNDRhLWQ3NGUwNjQ1ZGFiYy5hdnJvIiwKICAgICJzY2hlbWEtaWQiIDogMAogIH0gXSwKICAic3RhdGlzdGljcyIgOiBbIF0sCiAgInNuYXBzaG90LWxvZyIgOiBbIHsKICAgICJ0aW1lc3RhbXAtbXMiIDogMTc0ODAzNDY1MTE4NSwKICAgICJzbmFwc2hvdC1pZCIgOiAxMTYwOTQ1ODIzMTcyNjk4MDkwCiAgfSBdLAogICJtZXRhZGF0YS1sb2ciIDogWyBdCn0= | base64 --decode > /iceberg_data/default/test_delete_files_1_local_cfef13ac_d853_40d3_9aa3_0372c5be3b5c/metadata/v1.metadata.json'] (cluster.py:2045, exec_in_container) 2025-05-23 21:10:51 [ 671 ] DEBUG : Command:[docker exec rootteststorageiceberg-gw1-node1-1 bash -c mkdir -p $(dirname /iceberg_data/default/test_delete_files_1_local_cfef13ac_d853_40d3_9aa3_0372c5be3b5c/metadata/v1.metadata.json) && echo ewogICJmb3JtYXQtdmVyc2lvbiIgOiAxLAogICJ0YWJsZS11dWlkIiA6ICJlMjE0NTY3Ni00ZTkzLTRlMzQtOGU4Ni1kMzcwZWU0MDMzNTQiLAogICJsb2NhdGlvbiIgOiAiL2ljZWJlcmdfZGF0YS9kZWZhdWx0L3Rlc3RfZGVsZXRlX2ZpbGVzXzFfbG9jYWxfY2ZlZjEzYWNfZDg1M180MGQzXzlhYTNfMDM3MmM1YmUzYjVjIiwKICAibGFzdC11cGRhdGVkLW1zIiA6IDE3NDgwMzQ2NTExODUsCiAgImxhc3QtY29sdW1uLWlkIiA6IDIsCiAgInNjaGVtYSIgOiB7CiAgICAidHlwZSIgOiAic3RydWN0IiwKICAgICJzY2hlbWEtaWQiIDogMCwKICAgICJmaWVsZHMiIDogWyB7CiAgICAgICJpZCIgOiAxLAogICAgICAibmFtZSIgOiAiYSIsCiAgICAgICJyZXF1aXJlZCIgOiBmYWxzZSwKICAgICAgInR5cGUiIDogImxvbmciCiAgICB9LCB7CiAgICAgICJpZCIgOiAyLAogICAgICAibmFtZSIgOiAiYiIsCiAgICAgICJyZXF1aXJlZCIgOiBmYWxzZSwKICAgICAgInR5cGUiIDogInN0cmluZyIKICAgIH0gXQogIH0sCiAgImN1cnJlbnQtc2NoZW1hLWlkIiA6IDAsCiAgInNjaGVtYXMiIDogWyB7CiAgICAidHlwZSIgOiAic3RydWN0IiwKICAgICJzY2hlbWEtaWQiIDogMCwKICAgICJmaWVsZHMiIDogWyB7CiAgICAgICJpZCIgOiAxLAogICAgICAibmFtZSIgOiAiYSIsCiAgICAgICJyZXF1aXJlZCIgOiBmYWxzZSwKICAgICAgInR5cGUiIDogImxvbmciCiAgICB9LCB7CiAgICAgICJpZCIgOiAyLAogICAgICAibmFtZSIgOiAiYiIsCiAgICAgICJyZXF1aXJlZCIgOiBmYWxzZSwKICAgICAgInR5cGUiIDogInN0cmluZyIKICAgIH0gXQogIH0gXSwKICAicGFydGl0aW9uLXNwZWMiIDogWyBdLAogICJkZWZhdWx0LXNwZWMtaWQiIDogMCwKICAicGFydGl0aW9uLXNwZWNzIiA6IFsgewogICAgInNwZWMtaWQiIDogMCwKICAgICJmaWVsZHMiIDogWyBdCiAgfSBdLAogICJsYXN0LXBhcnRpdGlvbi1pZCIgOiA5OTksCiAgImRlZmF1bHQtc29ydC1vcmRlci1pZCIgOiAwLAogICJzb3J0LW9yZGVycyIgOiBbIHsKICAgICJvcmRlci1pZCIgOiAwLAogICAgImZpZWxkcyIgOiBbIF0KICB9IF0sCiAgInByb3BlcnRpZXMiIDogewogICAgIm93bmVyIiA6ICJyb290IgogIH0sCiAgImN1cnJlbnQtc25hcHNob3QtaWQiIDogMTE2MDk0NTgyMzE3MjY5ODA5MCwKICAicmVmcyIgOiB7CiAgICAibWFpbiIgOiB7CiAgICAgICJzbmFwc2hvdC1pZCIgOiAxMTYwOTQ1ODIzMTcyNjk4MDkwLAogICAgICAidHlwZSIgOiAiYnJhbmNoIgogICAgfQogIH0sCiAgInNuYXBzaG90cyIgOiBbIHsKICAgICJzbmFwc2hvdC1pZCIgOiAxMTYwOTQ1ODIzMTcyNjk4MDkwLAogICAgInRpbWVzdGFtcC1tcyIgOiAxNzQ4MDM0NjUxMTg1LAogICAgInN1bW1hcnkiIDogewogICAgICAib3BlcmF0aW9uIiA6ICJhcHBlbmQiLAogICAgICAic3BhcmsuYXBwLmlkIiA6ICJsb2NhbC0xNzQ4MDM0NjM2NDMyIiwKICAgICAgImFkZGVkLWRhdGEtZmlsZXMiIDogIjEiLAogICAgICAiYWRkZWQtcmVjb3JkcyIgOiAiMTAwIiwKICAgICAgImFkZGVkLWZpbGVzLXNpemUiIDogIjk2NyIsCiAgICAgICJjaGFuZ2VkLXBhcnRpdGlvbi1jb3VudCIgOiAiMSIsCiAgICAgICJ0b3RhbC1yZWNvcmRzIiA6ICIxMDAiLAogICAgICAidG90YWwtZmlsZXMtc2l6ZSIgOiAiOTY3IiwKICAgICAgInRvdGFsLWRhdGEtZmlsZXMiIDogIjEiLAogICAgICAidG90YWwtZGVsZXRlLWZpbGVzIiA6ICIwIiwKICAgICAgInRvdGFsLXBvc2l0aW9uLWRlbGV0ZXMiIDogIjAiLAogICAgICAidG90YWwtZXF1YWxpdHktZGVsZXRlcyIgOiAiMCIKICAgIH0sCiAgICAibWFuaWZlc3QtbGlzdCIgOiAiL2ljZWJlcmdfZGF0YS9kZWZhdWx0L3Rlc3RfZGVsZXRlX2ZpbGVzXzFfbG9jYWxfY2ZlZjEzYWNfZDg1M180MGQzXzlhYTNfMDM3MmM1YmUzYjVjL21ldGFkYXRhL3NuYXAtMTE2MDk0NTgyMzE3MjY5ODA5MC0xLTBhNjQzOTRjLWQzOGItNGUwZC1hNDRhLWQ3NGUwNjQ1ZGFiYy5hdnJvIiwKICAgICJzY2hlbWEtaWQiIDogMAogIH0gXSwKICAic3RhdGlzdGljcyIgOiBbIF0sCiAgInNuYXBzaG90LWxvZyIgOiBbIHsKICAgICJ0aW1lc3RhbXAtbXMiIDogMTc0ODAzNDY1MTE4NSwKICAgICJzbmFwc2hvdC1pZCIgOiAxMTYwOTQ1ODIzMTcyNjk4MDkwCiAgfSBdLAogICJtZXRhZGF0YS1sb2ciIDogWyBdCn0= | base64 --decode > /iceberg_data/default/test_delete_files_1_local_cfef13ac_d853_40d3_9aa3_0372c5be3b5c/metadata/v1.metadata.json] (cluster.py:121, run_and_check) 2025-05-23 21:10:51 [ 671 ] DEBUG : Executing query DROP TABLE IF EXISTS test_delete_files_1_local_cfef13ac_d853_40d3_9aa3_0372c5be3b5c SYNC on node1 (cluster.py:3570, query) 2025-05-23 21:10:51 [ 671 ] DEBUG : Executing query DROP TABLE IF EXISTS test_delete_files_1_local_cfef13ac_d853_40d3_9aa3_0372c5be3b5c; CREATE TABLE test_delete_files_1_local_cfef13ac_d853_40d3_9aa3_0372c5be3b5c ENGINE=IcebergLocal(local, path = '/iceberg_data/default/test_delete_files_1_local_cfef13ac_d853_40d3_9aa3_0372c5be3b5c/', format=Parquet) on node1 (cluster.py:3570, query) 2025-05-23 21:10:51 [ 671 ] DEBUG : Executing query SELECT count() FROM test_delete_files_1_local_cfef13ac_d853_40d3_9aa3_0372c5be3b5c on node1 (cluster.py:3570, query) 2025-05-23 21:10:51 [ 671 ] DEBUG : Executing query SYSTEM FLUSH LOGS on node1 (cluster.py:3570, query) 2025-05-23 21:10:51 [ 671 ] DEBUG : Executing query SELECT ProfileEvents['IcebergTrivialCountOptimizationApplied'] FROM system.query_log where query_id = 'test_trivial_count_fe4b506e_1091_4b83_9d31_f222bba16dd8' and type = 'QueryFinish' on node1 (cluster.py:3570, query) __________________________ test_delete_files[local-2] __________________________ [gw1] linux -- Python 3.10.12 /usr/bin/python3 started_cluster = format_version = '2', storage_type = 'local' @pytest.mark.parametrize("format_version", ["1", "2"]) @pytest.mark.parametrize("storage_type", ["s3", "azure", "local"]) def test_delete_files(started_cluster, format_version, storage_type): instance = started_cluster.instances["node1"] spark = started_cluster.spark_session TABLE_NAME = ( "test_delete_files_" + format_version + "_" + storage_type + "_" + get_uuid_str() ) write_iceberg_from_df( spark, generate_data(spark, 0, 100), TABLE_NAME, mode="overwrite", format_version=format_version, ) default_upload_directory( started_cluster, storage_type, f"/iceberg_data/default/{TABLE_NAME}/", f"/iceberg_data/default/{TABLE_NAME}/", ) create_iceberg_table(storage_type, instance, TABLE_NAME, started_cluster) # Test trivial count with deleted files query_id = "test_trivial_count_" + get_uuid_str() assert int(instance.query(f"SELECT count() FROM {TABLE_NAME}", query_id=query_id)) == 100 instance.query("SYSTEM FLUSH LOGS") > assert instance.query(f"SELECT ProfileEvents['IcebergTrivialCountOptimizationApplied'] FROM system.query_log where query_id = '{query_id}' and type = 'QueryFinish'") == "1\n" E AssertionError: assert '0\n' == '1\n' E - 1 E + 0 test_storage_iceberg/test.py:861: AssertionError ----------------------------- Captured stdout call ----------------------------- 25/05/23 21:10:52 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:52 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:52 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:52 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:52 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:52 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. {} {} {} ------------------------------ Captured log call ------------------------------- 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yro646 (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: c o646 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: c o61 range i0 i100 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yro647 (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !ylo648 (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: c o648 add sa e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro648 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yro649 (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: c o647 toDF ro649 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yro650 (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yro651 (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: c o651 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: c o61 range i1 i101 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yro652 (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !ylo653 (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: c o653 add sb e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro653 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yro654 (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: c o652 toDF ro654 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yro655 (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: c o655 apply sb e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yro656 (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yro657 (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: c o657 isDefined e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yro658 (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: c o658 get e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yro659 (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yro660 (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yao661 (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: c o660 applyModifiableSettings ro659 ro661 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: c o61 parseDataType s"string" e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yro662 (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: c o656 cast ro662 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yro663 (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: c o655 withColumn sb ro663 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yro664 (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yro665 (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yro666 (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !ylo667 (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: c o667 add ro666 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro667 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yro668 (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro668 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yro669 (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: c o665 over ro669 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yro670 (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: c o650 withColumn srow_index ro670 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yro671 (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yro672 (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yro673 (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !ylo674 (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: c o674 add ro673 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro674 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yro675 (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro675 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yro676 (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: c o672 over ro676 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yro677 (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: c o664 withColumn srow_index ro677 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yro678 (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !ylo679 (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: c o679 add srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro679 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yro680 (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: c o671 join ro678 ro680 sinner e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yro681 (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: c o681 drop srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yro682 (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: c o682 writeTo stest_delete_files_2_local_68280c14_1c48_4c18_a7eb_03d3e15553d7 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yro683 (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: c o683 tableProperty sformat-version s2 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yro684 (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: c o683 using siceberg e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yro685 (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: c o683 create e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : run container_id:rootteststorageiceberg-gw1-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p /iceberg_data/default/test_delete_files_2_local_68280c14_1c48_4c18_a7eb_03d3e15553d7/data'] (cluster.py:2045, exec_in_container) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command:[docker exec rootteststorageiceberg-gw1-node1-1 bash -c mkdir -p /iceberg_data/default/test_delete_files_2_local_68280c14_1c48_4c18_a7eb_03d3e15553d7/data] (cluster.py:121, run_and_check) 2025-05-23 21:10:52 [ 671 ] DEBUG : run container_id:rootteststorageiceberg-gw1-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname /iceberg_data/default/test_delete_files_2_local_68280c14_1c48_4c18_a7eb_03d3e15553d7/data/00000-31-547c3c67-721c-4b36-a70c-7ccff052fa08-00001.parquet) && echo UEFSMRUAFcAMFfYCFb3z1JUGHBXIARUAFQgVCAAAH4sIAAAAAAAAAC3F1yICAAAAwJBZIVskK7OyM0OK7IzKjvL//+DB3csFAv9a3Oo2B93uDne6y93ucchhR9zrPvc76gEPesjDHvGoxzzumCc86binnPC0ZzzrOc876QUvesnLXvGqU0474zWve8Ob3vK2d5z1rve87wMf+sg5H/vEp877zAUXfe4Ll3zpK1/7xre+873LfvCjn/zsiquu+cWvfvO7P/zpL9f97R833PSv/wACwudxIAMAABUAFaAJFeoCFY28v7gJHBXIARUAFQgVCAAAH4sIAAAAAAAAAB3SsYFCMQxEwQ/XEFiyJPffGOdJXrST7et5nu/rP+smbvJm39RN38zNed/xR7+6NDR1a2nrKLvYxS52sYtd7GIXu9jFBhtssMEGG2ywwQYbbLLJJptssskmm2yyyW52s5vd7GY3u9nNbnazxRZbbLHFFltsscUW22yzzTbbbLPNNttss8MOO+ywww477LDDDnvYwx72sIc97GEPe9hz/nzj8wPU24atUAIAABkRAhkYCAAAAAAAAAAAGRgIYwAAAAAAAAAVAhkWAAAZEQIZGAExGRgCOTkVAhkWAAAZHBYIFaoDFgAAABkcFrIDFZ4DFgAAABUCGTxIBXRhYmxlFQQAFQQlABgBYVUCABUMJQAYAWIlADUEHBwAAAAWyAEZHBksJggcFQQZJQAIGRgBYRUEFsgBFvQMFqoDJgg8GAhjAAAAAAAAABgIAAAAAAAAAAAWACgIYwAAAAAAAAAYCAAAAAAAAAAAABkcFQAVABUCAAAWsgcVFhbQBhU+ACayAxwVDBklAAgZGAFiFQQWyAEW1AkWngMmsgM8NgAoAjk5GAExABkcFQAVABUCAAAWyAcVGBaOBxUkABbIFhbIASYIFsgGFAAAGRwYDmljZWJlcmcuc2NoZW1hGJABeyJ0eXBlIjoic3RydWN0Iiwic2NoZW1hLWlkIjowLCJmaWVsZHMiOlt7ImlkIjoxLCJuYW1lIjoiYSIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjoibG9uZyJ9LHsiaWQiOjIsIm5hbWUiOiJiIiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJzdHJpbmcifV19ABhKcGFycXVldC1tciB2ZXJzaW9uIDEuMTIuMyAoYnVpbGQgZjhkY2VkMTgyYzRjMWZiZGVjNmNjYjMxODU1MzdiNWEwMWU2ZWQ2YikZLBwAABwAAADPAQAAUEFSMQ== | base64 --decode > /iceberg_data/default/test_delete_files_2_local_68280c14_1c48_4c18_a7eb_03d3e15553d7/data/00000-31-547c3c67-721c-4b36-a70c-7ccff052fa08-00001.parquet'] (cluster.py:2045, exec_in_container) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command:[docker exec rootteststorageiceberg-gw1-node1-1 bash -c mkdir -p $(dirname /iceberg_data/default/test_delete_files_2_local_68280c14_1c48_4c18_a7eb_03d3e15553d7/data/00000-31-547c3c67-721c-4b36-a70c-7ccff052fa08-00001.parquet) && echo UEFSMRUAFcAMFfYCFb3z1JUGHBXIARUAFQgVCAAAH4sIAAAAAAAAAC3F1yICAAAAwJBZIVskK7OyM0OK7IzKjvL//+DB3csFAv9a3Oo2B93uDne6y93ucchhR9zrPvc76gEPesjDHvGoxzzumCc86binnPC0ZzzrOc876QUvesnLXvGqU0474zWve8Ob3vK2d5z1rve87wMf+sg5H/vEp877zAUXfe4Ll3zpK1/7xre+873LfvCjn/zsiquu+cWvfvO7P/zpL9f97R833PSv/wACwudxIAMAABUAFaAJFeoCFY28v7gJHBXIARUAFQgVCAAAH4sIAAAAAAAAAB3SsYFCMQxEwQ/XEFiyJPffGOdJXrST7et5nu/rP+smbvJm39RN38zNed/xR7+6NDR1a2nrKLvYxS52sYtd7GIXu9jFBhtssMEGG2ywwQYbbLLJJptssskmm2yyyW52s5vd7GY3u9nNbnazxRZbbLHFFltsscUW22yzzTbbbLPNNttss8MOO+ywww477LDDDnvYwx72sIc97GEPe9hz/nzj8wPU24atUAIAABkRAhkYCAAAAAAAAAAAGRgIYwAAAAAAAAAVAhkWAAAZEQIZGAExGRgCOTkVAhkWAAAZHBYIFaoDFgAAABkcFrIDFZ4DFgAAABUCGTxIBXRhYmxlFQQAFQQlABgBYVUCABUMJQAYAWIlADUEHBwAAAAWyAEZHBksJggcFQQZJQAIGRgBYRUEFsgBFvQMFqoDJgg8GAhjAAAAAAAAABgIAAAAAAAAAAAWACgIYwAAAAAAAAAYCAAAAAAAAAAAABkcFQAVABUCAAAWsgcVFhbQBhU+ACayAxwVDBklAAgZGAFiFQQWyAEW1AkWngMmsgM8NgAoAjk5GAExABkcFQAVABUCAAAWyAcVGBaOBxUkABbIFhbIASYIFsgGFAAAGRwYDmljZWJlcmcuc2NoZW1hGJABeyJ0eXBlIjoic3RydWN0Iiwic2NoZW1hLWlkIjowLCJmaWVsZHMiOlt7ImlkIjoxLCJuYW1lIjoiYSIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjoibG9uZyJ9LHsiaWQiOjIsIm5hbWUiOiJiIiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJzdHJpbmcifV19ABhKcGFycXVldC1tciB2ZXJzaW9uIDEuMTIuMyAoYnVpbGQgZjhkY2VkMTgyYzRjMWZiZGVjNmNjYjMxODU1MzdiNWEwMWU2ZWQ2YikZLBwAABwAAADPAQAAUEFSMQ== | base64 --decode > /iceberg_data/default/test_delete_files_2_local_68280c14_1c48_4c18_a7eb_03d3e15553d7/data/00000-31-547c3c67-721c-4b36-a70c-7ccff052fa08-00001.parquet] (cluster.py:121, run_and_check) 2025-05-23 21:10:52 [ 671 ] DEBUG : run container_id:rootteststorageiceberg-gw1-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p /iceberg_data/default/test_delete_files_2_local_68280c14_1c48_4c18_a7eb_03d3e15553d7/metadata'] (cluster.py:2045, exec_in_container) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command:[docker exec rootteststorageiceberg-gw1-node1-1 bash -c mkdir -p /iceberg_data/default/test_delete_files_2_local_68280c14_1c48_4c18_a7eb_03d3e15553d7/metadata] (cluster.py:121, run_and_check) 2025-05-23 21:10:52 [ 671 ] DEBUG : run container_id:rootteststorageiceberg-gw1-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname /iceberg_data/default/test_delete_files_2_local_68280c14_1c48_4c18_a7eb_03d3e15553d7/metadata/542b637b-0cae-4cda-a903-ab5fdd4b94e5-m0.avro) && echo T2JqARAMc2NoZW1hpAJ7InR5cGUiOiJzdHJ1Y3QiLCJzY2hlbWEtaWQiOjAsImZpZWxkcyI6W3siaWQiOjEsIm5hbWUiOiJhIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoibG9uZyJ9LHsiaWQiOjIsIm5hbWUiOiJiIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoic3RyaW5nIn1dfRZhdnJvLnNjaGVtYZI1eyJ0eXBlIjoicmVjb3JkIiwibmFtZSI6Im1hbmlmZXN0X2VudHJ5IiwiZmllbGRzIjpbeyJuYW1lIjoic3RhdHVzIiwidHlwZSI6ImludCIsImZpZWxkLWlkIjowfSx7Im5hbWUiOiJzbmFwc2hvdF9pZCIsInR5cGUiOlsibnVsbCIsImxvbmciXSwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjF9LHsibmFtZSI6InNlcXVlbmNlX251bWJlciIsInR5cGUiOlsibnVsbCIsImxvbmciXSwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjN9LHsibmFtZSI6ImZpbGVfc2VxdWVuY2VfbnVtYmVyIiwidHlwZSI6WyJudWxsIiwibG9uZyJdLCJkZWZhdWx0IjpudWxsLCJmaWVsZC1pZCI6NH0seyJuYW1lIjoiZGF0YV9maWxlIiwidHlwZSI6eyJ0eXBlIjoicmVjb3JkIiwibmFtZSI6InIyIiwiZmllbGRzIjpbeyJuYW1lIjoiY29udGVudCIsInR5cGUiOiJpbnQiLCJkb2MiOiJDb250ZW50cyBvZiB0aGUgZmlsZTogMD1kYXRhLCAxPXBvc2l0aW9uIGRlbGV0ZXMsIDI9ZXF1YWxpdHkgZGVsZXRlcyIsImZpZWxkLWlkIjoxMzR9LHsibmFtZSI6ImZpbGVfcGF0aCIsInR5cGUiOiJzdHJpbmciLCJkb2MiOiJMb2NhdGlvbiBVUkkgd2l0aCBGUyBzY2hlbWUiLCJmaWVsZC1pZCI6MTAwfSx7Im5hbWUiOiJmaWxlX2Zvcm1hdCIsInR5cGUiOiJzdHJpbmciLCJkb2MiOiJGaWxlIGZvcm1hdCBuYW1lOiBhdnJvLCBvcmMsIG9yIHBhcnF1ZXQiLCJmaWVsZC1pZCI6MTAxfSx7Im5hbWUiOiJwYXJ0aXRpb24iLCJ0eXBlIjp7InR5cGUiOiJyZWNvcmQiLCJuYW1lIjoicjEwMiIsImZpZWxkcyI6W119LCJkb2MiOiJQYXJ0aXRpb24gZGF0YSB0dXBsZSwgc2NoZW1hIGJhc2VkIG9uIHRoZSBwYXJ0aXRpb24gc3BlYyIsImZpZWxkLWlkIjoxMDJ9LHsibmFtZSI6InJlY29yZF9jb3VudCIsInR5cGUiOiJsb25nIiwiZG9jIjoiTnVtYmVyIG9mIHJlY29yZHMgaW4gdGhlIGZpbGUiLCJmaWVsZC1pZCI6MTAzfSx7Im5hbWUiOiJmaWxlX3NpemVfaW5fYnl0ZXMiLCJ0eXBlIjoibG9uZyIsImRvYyI6IlRvdGFsIGZpbGUgc2l6ZSBpbiBieXRlcyIsImZpZWxkLWlkIjoxMDR9LHsibmFtZSI6ImNvbHVtbl9zaXplcyIsInR5cGUiOlsibnVsbCIseyJ0eXBlIjoiYXJyYXkiLCJpdGVtcyI6eyJ0eXBlIjoicmVjb3JkIiwibmFtZSI6ImsxMTdfdjExOCIsImZpZWxkcyI6W3sibmFtZSI6ImtleSIsInR5cGUiOiJpbnQiLCJmaWVsZC1pZCI6MTE3fSx7Im5hbWUiOiJ2YWx1ZSIsInR5cGUiOiJsb25nIiwiZmllbGQtaWQiOjExOH1dfSwibG9naWNhbFR5cGUiOiJtYXAifV0sImRvYyI6Ik1hcCBvZiBjb2x1bW4gaWQgdG8gdG90YWwgc2l6ZSBvbiBkaXNrIiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjEwOH0seyJuYW1lIjoidmFsdWVfY291bnRzIiwidHlwZSI6WyJudWxsIix7InR5cGUiOiJhcnJheSIsIml0ZW1zIjp7InR5cGUiOiJyZWNvcmQiLCJuYW1lIjoiazExOV92MTIwIiwiZmllbGRzIjpbeyJuYW1lIjoia2V5IiwidHlwZSI6ImludCIsImZpZWxkLWlkIjoxMTl9LHsibmFtZSI6InZhbHVlIiwidHlwZSI6ImxvbmciLCJmaWVsZC1pZCI6MTIwfV19LCJsb2dpY2FsVHlwZSI6Im1hcCJ9XSwiZG9jIjoiTWFwIG9mIGNvbHVtbiBpZCB0byB0b3RhbCBjb3VudCwgaW5jbHVkaW5nIG51bGwgYW5kIE5hTiIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjoxMDl9LHsibmFtZSI6Im51bGxfdmFsdWVfY291bnRzIiwidHlwZSI6WyJudWxsIix7InR5cGUiOiJhcnJheSIsIml0ZW1zIjp7InR5cGUiOiJyZWNvcmQiLCJuYW1lIjoiazEyMV92MTIyIiwiZmllbGRzIjpbeyJuYW1lIjoia2V5IiwidHlwZSI6ImludCIsImZpZWxkLWlkIjoxMjF9LHsibmFtZSI6InZhbHVlIiwidHlwZSI6ImxvbmciLCJmaWVsZC1pZCI6MTIyfV19LCJsb2dpY2FsVHlwZSI6Im1hcCJ9XSwiZG9jIjoiTWFwIG9mIGNvbHVtbiBpZCB0byBudWxsIHZhbHVlIGNvdW50IiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjExMH0seyJuYW1lIjoibmFuX3ZhbHVlX2NvdW50cyIsInR5cGUiOlsibnVsbCIseyJ0eXBlIjoiYXJyYXkiLCJpdGVtcyI6eyJ0eXBlIjoicmVjb3JkIiwibmFtZSI6ImsxMzhfdjEzOSIsImZpZWxkcyI6W3sibmFtZSI6ImtleSIsInR5cGUiOiJpbnQiLCJmaWVsZC1pZCI6MTM4fSx7Im5hbWUiOiJ2YWx1ZSIsInR5cGUiOiJsb25nIiwiZmllbGQtaWQiOjEzOX1dfSwibG9naWNhbFR5cGUiOiJtYXAifV0sImRvYyI6Ik1hcCBvZiBjb2x1bW4gaWQgdG8gbnVtYmVyIG9mIE5hTiB2YWx1ZXMgaW4gdGhlIGNvbHVtbiIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjoxMzd9LHsibmFtZSI6Imxvd2VyX2JvdW5kcyIsInR5cGUiOlsibnVsbCIseyJ0eXBlIjoiYXJyYXkiLCJpdGVtcyI6eyJ0eXBlIjoicmVjb3JkIiwibmFtZSI6ImsxMjZfdjEyNyIsImZpZWxkcyI6W3sibmFtZSI6ImtleSIsInR5cGUiOiJpbnQiLCJmaWVsZC1pZCI6MTI2fSx7Im5hbWUiOiJ2YWx1ZSIsInR5cGUiOiJieXRlcyIsImZpZWxkLWlkIjoxMjd9XX0sImxvZ2ljYWxUeXBlIjoibWFwIn1dLCJkb2MiOiJNYXAgb2YgY29sdW1uIGlkIHRvIGxvd2VyIGJvdW5kIiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjEyNX0seyJuYW1lIjoidXBwZXJfYm91bmRzIiwidHlwZSI6WyJudWxsIix7InR5cGUiOiJhcnJheSIsIml0ZW1zIjp7InR5cGUiOiJyZWNvcmQiLCJuYW1lIjoiazEyOV92MTMwIiwiZmllbGRzIjpbeyJuYW1lIjoia2V5IiwidHlwZSI6ImludCIsImZpZWxkLWlkIjoxMjl9LHsibmFtZSI6InZhbHVlIiwidHlwZSI6ImJ5dGVzIiwiZmllbGQtaWQiOjEzMH1dfSwibG9naWNhbFR5cGUiOiJtYXAifV0sImRvYyI6Ik1hcCBvZiBjb2x1bW4gaWQgdG8gdXBwZXIgYm91bmQiLCJkZWZhdWx0IjpudWxsLCJmaWVsZC1pZCI6MTI4fSx7Im5hbWUiOiJrZXlfbWV0YWRhdGEiLCJ0eXBlIjpbIm51bGwiLCJieXRlcyJdLCJkb2MiOiJFbmNyeXB0aW9uIGtleSBtZXRhZGF0YSBibG9iIiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjEzMX0seyJuYW1lIjoic3BsaXRfb2Zmc2V0cyIsInR5cGUiOlsibnVsbCIseyJ0eXBlIjoiYXJyYXkiLCJpdGVtcyI6ImxvbmciLCJlbGVtZW50LWlkIjoxMzN9XSwiZG9jIjoiU3BsaXR0YWJsZSBvZmZzZXRzIiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjEzMn0seyJuYW1lIjoiZXF1YWxpdHlfaWRzIiwidHlwZSI6WyJudWxsIix7InR5cGUiOiJhcnJheSIsIml0ZW1zIjoiaW50IiwiZWxlbWVudC1pZCI6MTM2fV0sImRvYyI6IkVxdWFsaXR5IGNvbXBhcmlzb24gZmllbGQgSURzIiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjEzNX0seyJuYW1lIjoic29ydF9vcmRlcl9pZCIsInR5cGUiOlsibnVsbCIsImludCJdLCJkb2MiOiJTb3J0IG9yZGVyIElEIiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjE0MH1dfSwiZmllbGQtaWQiOjJ9XX0UYXZyby5jb2RlYw5kZWZsYXRlHGZvcm1hdC12ZXJzaW9uAjIicGFydGl0aW9uLXNwZWMtaWQCMBxpY2ViZXJnLnNjaGVtYcoreyJ0eXBlIjoic3RydWN0Iiwic2NoZW1hLWlkIjowLCJmaWVsZHMiOlt7ImlkIjowLCJuYW1lIjoic3RhdHVzIiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJpbnQifSx7ImlkIjoxLCJuYW1lIjoic25hcHNob3RfaWQiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOiJsb25nIn0seyJpZCI6MywibmFtZSI6InNlcXVlbmNlX251bWJlciIsInJlcXVpcmVkIjpmYWxzZSwidHlwZSI6ImxvbmcifSx7ImlkIjo0LCJuYW1lIjoiZmlsZV9zZXF1ZW5jZV9udW1iZXIiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOiJsb25nIn0seyJpZCI6MiwibmFtZSI6ImRhdGFfZmlsZSIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjp7InR5cGUiOiJzdHJ1Y3QiLCJmaWVsZHMiOlt7ImlkIjoxMzQsIm5hbWUiOiJjb250ZW50IiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJpbnQiLCJkb2MiOiJDb250ZW50cyBvZiB0aGUgZmlsZTogMD1kYXRhLCAxPXBvc2l0aW9uIGRlbGV0ZXMsIDI9ZXF1YWxpdHkgZGVsZXRlcyJ9LHsiaWQiOjEwMCwibmFtZSI6ImZpbGVfcGF0aCIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjoic3RyaW5nIiwiZG9jIjoiTG9jYXRpb24gVVJJIHdpdGggRlMgc2NoZW1lIn0seyJpZCI6MTAxLCJuYW1lIjoiZmlsZV9mb3JtYXQiLCJyZXF1aXJlZCI6dHJ1ZSwidHlwZSI6InN0cmluZyIsImRvYyI6IkZpbGUgZm9ybWF0IG5hbWU6IGF2cm8sIG9yYywgb3IgcGFycXVldCJ9LHsiaWQiOjEwMiwibmFtZSI6InBhcnRpdGlvbiIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjp7InR5cGUiOiJzdHJ1Y3QiLCJmaWVsZHMiOltdfSwiZG9jIjoiUGFydGl0aW9uIGRhdGEgdHVwbGUsIHNjaGVtYSBiYXNlZCBvbiB0aGUgcGFydGl0aW9uIHNwZWMifSx7ImlkIjoxMDMsIm5hbWUiOiJyZWNvcmRfY291bnQiLCJyZXF1aXJlZCI6dHJ1ZSwidHlwZSI6ImxvbmciLCJkb2MiOiJOdW1iZXIgb2YgcmVjb3JkcyBpbiB0aGUgZmlsZSJ9LHsiaWQiOjEwNCwibmFtZSI6ImZpbGVfc2l6ZV9pbl9ieXRlcyIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjoibG9uZyIsImRvYyI6IlRvdGFsIGZpbGUgc2l6ZSBpbiBieXRlcyJ9LHsiaWQiOjEwOCwibmFtZSI6ImNvbHVtbl9zaXplcyIsInJlcXVpcmVkIjpmYWxzZSwidHlwZSI6eyJ0eXBlIjoibWFwIiwia2V5LWlkIjoxMTcsImtleSI6ImludCIsInZhbHVlLWlkIjoxMTgsInZhbHVlIjoibG9uZyIsInZhbHVlLXJlcXVpcmVkIjp0cnVlfSwiZG9jIjoiTWFwIG9mIGNvbHVtbiBpZCB0byB0b3RhbCBzaXplIG9uIGRpc2sifSx7ImlkIjoxMDksIm5hbWUiOiJ2YWx1ZV9jb3VudHMiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOnsidHlwZSI6Im1hcCIsImtleS1pZCI6MTE5LCJrZXkiOiJpbnQiLCJ2YWx1ZS1pZCI6MTIwLCJ2YWx1ZSI6ImxvbmciLCJ2YWx1ZS1yZXF1aXJlZCI6dHJ1ZX0sImRvYyI6Ik1hcCBvZiBjb2x1bW4gaWQgdG8gdG90YWwgY291bnQsIGluY2x1ZGluZyBudWxsIGFuZCBOYU4ifSx7ImlkIjoxMTAsIm5hbWUiOiJudWxsX3ZhbHVlX2NvdW50cyIsInJlcXVpcmVkIjpmYWxzZSwidHlwZSI6eyJ0eXBlIjoibWFwIiwia2V5LWlkIjoxMjEsImtleSI6ImludCIsInZhbHVlLWlkIjoxMjIsInZhbHVlIjoibG9uZyIsInZhbHVlLXJlcXVpcmVkIjp0cnVlfSwiZG9jIjoiTWFwIG9mIGNvbHVtbiBpZCB0byBudWxsIHZhbHVlIGNvdW50In0seyJpZCI6MTM3LCJuYW1lIjoibmFuX3ZhbHVlX2NvdW50cyIsInJlcXVpcmVkIjpmYWxzZSwidHlwZSI6eyJ0eXBlIjoibWFwIiwia2V5LWlkIjoxMzgsImtleSI6ImludCIsInZhbHVlLWlkIjoxMzksInZhbHVlIjoibG9uZyIsInZhbHVlLXJlcXVpcmVkIjp0cnVlfSwiZG9jIjoiTWFwIG9mIGNvbHVtbiBpZCB0byBudW1iZXIgb2YgTmFOIHZhbHVlcyBpbiB0aGUgY29sdW1uIn0seyJpZCI6MTI1LCJuYW1lIjoibG93ZXJfYm91bmRzIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjp7InR5cGUiOiJtYXAiLCJrZXktaWQiOjEyNiwia2V5IjoiaW50IiwidmFsdWUtaWQiOjEyNywidmFsdWUiOiJiaW5hcnkiLCJ2YWx1ZS1yZXF1aXJlZCI6dHJ1ZX0sImRvYyI6Ik1hcCBvZiBjb2x1bW4gaWQgdG8gbG93ZXIgYm91bmQifSx7ImlkIjoxMjgsIm5hbWUiOiJ1cHBlcl9ib3VuZHMiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOnsidHlwZSI6Im1hcCIsImtleS1pZCI6MTI5LCJrZXkiOiJpbnQiLCJ2YWx1ZS1pZCI6MTMwLCJ2YWx1ZSI6ImJpbmFyeSIsInZhbHVlLXJlcXVpcmVkIjp0cnVlfSwiZG9jIjoiTWFwIG9mIGNvbHVtbiBpZCB0byB1cHBlciBib3VuZCJ9LHsiaWQiOjEzMSwibmFtZSI6ImtleV9tZXRhZGF0YSIsInJlcXVpcmVkIjpmYWxzZSwidHlwZSI6ImJpbmFyeSIsImRvYyI6IkVuY3J5cHRpb24ga2V5IG1ldGFkYXRhIGJsb2IifSx7ImlkIjoxMzIsIm5hbWUiOiJzcGxpdF9vZmZzZXRzIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjp7InR5cGUiOiJsaXN0IiwiZWxlbWVudC1pZCI6MTMzLCJlbGVtZW50IjoibG9uZyIsImVsZW1lbnQtcmVxdWlyZWQiOnRydWV9LCJkb2MiOiJTcGxpdHRhYmxlIG9mZnNldHMifSx7ImlkIjoxMzUsIm5hbWUiOiJlcXVhbGl0eV9pZHMiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOnsidHlwZSI6Imxpc3QiLCJlbGVtZW50LWlkIjoxMzYsImVsZW1lbnQiOiJpbnQiLCJlbGVtZW50LXJlcXVpcmVkIjp0cnVlfSwiZG9jIjoiRXF1YWxpdHkgY29tcGFyaXNvbiBmaWVsZCBJRHMifSx7ImlkIjoxNDAsIm5hbWUiOiJzb3J0X29yZGVyX2lkIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoiaW50IiwiZG9jIjoiU29ydCBvcmRlciBJRCJ9XX19XX0ccGFydGl0aW9uLXNwZWMEW10OY29udGVudAhkYXRhAMa4rsHHfaK26SVRsXCn8LwCoAM1jDFOAzEQRb2OCyrgImbttb12GiQKekBQj7zjMYpkCUicK1ByASQOkJYbUG3BJTgDHIA4gle9Lz19zp+/338+v14/zhljO96vkCZa30OKNfaJctyW2lfaVEhUqBLkVaENDFAeMBYYwxAUagsabQCLOkD0NIEyyZB2zpnk+8OXakijpbMeDY5e+kGjtJMZZfQKpUfMWbkhRxVki/XZY1w/bakeX13cXN9d3s7dywkXfLcQbwu2l7kTc9eECcZ4k1P2h+D6sPF/i+Vy3/CjFv4Cxriuwcd9orbpJVGxcKfwvA== | base64 --decode > /iceberg_data/default/test_delete_files_2_local_68280c14_1c48_4c18_a7eb_03d3e15553d7/metadata/542b637b-0cae-4cda-a903-ab5fdd4b94e5-m0.avro'] (cluster.py:2045, exec_in_container) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command:[docker exec rootteststorageiceberg-gw1-node1-1 bash -c mkdir -p $(dirname /iceberg_data/default/test_delete_files_2_local_68280c14_1c48_4c18_a7eb_03d3e15553d7/metadata/542b637b-0cae-4cda-a903-ab5fdd4b94e5-m0.avro) && echo T2JqARAMc2NoZW1hpAJ7InR5cGUiOiJzdHJ1Y3QiLCJzY2hlbWEtaWQiOjAsImZpZWxkcyI6W3siaWQiOjEsIm5hbWUiOiJhIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoibG9uZyJ9LHsiaWQiOjIsIm5hbWUiOiJiIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoic3RyaW5nIn1dfRZhdnJvLnNjaGVtYZI1eyJ0eXBlIjoicmVjb3JkIiwibmFtZSI6Im1hbmlmZXN0X2VudHJ5IiwiZmllbGRzIjpbeyJuYW1lIjoic3RhdHVzIiwidHlwZSI6ImludCIsImZpZWxkLWlkIjowfSx7Im5hbWUiOiJzbmFwc2hvdF9pZCIsInR5cGUiOlsibnVsbCIsImxvbmciXSwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjF9LHsibmFtZSI6InNlcXVlbmNlX251bWJlciIsInR5cGUiOlsibnVsbCIsImxvbmciXSwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjN9LHsibmFtZSI6ImZpbGVfc2VxdWVuY2VfbnVtYmVyIiwidHlwZSI6WyJudWxsIiwibG9uZyJdLCJkZWZhdWx0IjpudWxsLCJmaWVsZC1pZCI6NH0seyJuYW1lIjoiZGF0YV9maWxlIiwidHlwZSI6eyJ0eXBlIjoicmVjb3JkIiwibmFtZSI6InIyIiwiZmllbGRzIjpbeyJuYW1lIjoiY29udGVudCIsInR5cGUiOiJpbnQiLCJkb2MiOiJDb250ZW50cyBvZiB0aGUgZmlsZTogMD1kYXRhLCAxPXBvc2l0aW9uIGRlbGV0ZXMsIDI9ZXF1YWxpdHkgZGVsZXRlcyIsImZpZWxkLWlkIjoxMzR9LHsibmFtZSI6ImZpbGVfcGF0aCIsInR5cGUiOiJzdHJpbmciLCJkb2MiOiJMb2NhdGlvbiBVUkkgd2l0aCBGUyBzY2hlbWUiLCJmaWVsZC1pZCI6MTAwfSx7Im5hbWUiOiJmaWxlX2Zvcm1hdCIsInR5cGUiOiJzdHJpbmciLCJkb2MiOiJGaWxlIGZvcm1hdCBuYW1lOiBhdnJvLCBvcmMsIG9yIHBhcnF1ZXQiLCJmaWVsZC1pZCI6MTAxfSx7Im5hbWUiOiJwYXJ0aXRpb24iLCJ0eXBlIjp7InR5cGUiOiJyZWNvcmQiLCJuYW1lIjoicjEwMiIsImZpZWxkcyI6W119LCJkb2MiOiJQYXJ0aXRpb24gZGF0YSB0dXBsZSwgc2NoZW1hIGJhc2VkIG9uIHRoZSBwYXJ0aXRpb24gc3BlYyIsImZpZWxkLWlkIjoxMDJ9LHsibmFtZSI6InJlY29yZF9jb3VudCIsInR5cGUiOiJsb25nIiwiZG9jIjoiTnVtYmVyIG9mIHJlY29yZHMgaW4gdGhlIGZpbGUiLCJmaWVsZC1pZCI6MTAzfSx7Im5hbWUiOiJmaWxlX3NpemVfaW5fYnl0ZXMiLCJ0eXBlIjoibG9uZyIsImRvYyI6IlRvdGFsIGZpbGUgc2l6ZSBpbiBieXRlcyIsImZpZWxkLWlkIjoxMDR9LHsibmFtZSI6ImNvbHVtbl9zaXplcyIsInR5cGUiOlsibnVsbCIseyJ0eXBlIjoiYXJyYXkiLCJpdGVtcyI6eyJ0eXBlIjoicmVjb3JkIiwibmFtZSI6ImsxMTdfdjExOCIsImZpZWxkcyI6W3sibmFtZSI6ImtleSIsInR5cGUiOiJpbnQiLCJmaWVsZC1pZCI6MTE3fSx7Im5hbWUiOiJ2YWx1ZSIsInR5cGUiOiJsb25nIiwiZmllbGQtaWQiOjExOH1dfSwibG9naWNhbFR5cGUiOiJtYXAifV0sImRvYyI6Ik1hcCBvZiBjb2x1bW4gaWQgdG8gdG90YWwgc2l6ZSBvbiBkaXNrIiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjEwOH0seyJuYW1lIjoidmFsdWVfY291bnRzIiwidHlwZSI6WyJudWxsIix7InR5cGUiOiJhcnJheSIsIml0ZW1zIjp7InR5cGUiOiJyZWNvcmQiLCJuYW1lIjoiazExOV92MTIwIiwiZmllbGRzIjpbeyJuYW1lIjoia2V5IiwidHlwZSI6ImludCIsImZpZWxkLWlkIjoxMTl9LHsibmFtZSI6InZhbHVlIiwidHlwZSI6ImxvbmciLCJmaWVsZC1pZCI6MTIwfV19LCJsb2dpY2FsVHlwZSI6Im1hcCJ9XSwiZG9jIjoiTWFwIG9mIGNvbHVtbiBpZCB0byB0b3RhbCBjb3VudCwgaW5jbHVkaW5nIG51bGwgYW5kIE5hTiIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjoxMDl9LHsibmFtZSI6Im51bGxfdmFsdWVfY291bnRzIiwidHlwZSI6WyJudWxsIix7InR5cGUiOiJhcnJheSIsIml0ZW1zIjp7InR5cGUiOiJyZWNvcmQiLCJuYW1lIjoiazEyMV92MTIyIiwiZmllbGRzIjpbeyJuYW1lIjoia2V5IiwidHlwZSI6ImludCIsImZpZWxkLWlkIjoxMjF9LHsibmFtZSI6InZhbHVlIiwidHlwZSI6ImxvbmciLCJmaWVsZC1pZCI6MTIyfV19LCJsb2dpY2FsVHlwZSI6Im1hcCJ9XSwiZG9jIjoiTWFwIG9mIGNvbHVtbiBpZCB0byBudWxsIHZhbHVlIGNvdW50IiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjExMH0seyJuYW1lIjoibmFuX3ZhbHVlX2NvdW50cyIsInR5cGUiOlsibnVsbCIseyJ0eXBlIjoiYXJyYXkiLCJpdGVtcyI6eyJ0eXBlIjoicmVjb3JkIiwibmFtZSI6ImsxMzhfdjEzOSIsImZpZWxkcyI6W3sibmFtZSI6ImtleSIsInR5cGUiOiJpbnQiLCJmaWVsZC1pZCI6MTM4fSx7Im5hbWUiOiJ2YWx1ZSIsInR5cGUiOiJsb25nIiwiZmllbGQtaWQiOjEzOX1dfSwibG9naWNhbFR5cGUiOiJtYXAifV0sImRvYyI6Ik1hcCBvZiBjb2x1bW4gaWQgdG8gbnVtYmVyIG9mIE5hTiB2YWx1ZXMgaW4gdGhlIGNvbHVtbiIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjoxMzd9LHsibmFtZSI6Imxvd2VyX2JvdW5kcyIsInR5cGUiOlsibnVsbCIseyJ0eXBlIjoiYXJyYXkiLCJpdGVtcyI6eyJ0eXBlIjoicmVjb3JkIiwibmFtZSI6ImsxMjZfdjEyNyIsImZpZWxkcyI6W3sibmFtZSI6ImtleSIsInR5cGUiOiJpbnQiLCJmaWVsZC1pZCI6MTI2fSx7Im5hbWUiOiJ2YWx1ZSIsInR5cGUiOiJieXRlcyIsImZpZWxkLWlkIjoxMjd9XX0sImxvZ2ljYWxUeXBlIjoibWFwIn1dLCJkb2MiOiJNYXAgb2YgY29sdW1uIGlkIHRvIGxvd2VyIGJvdW5kIiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjEyNX0seyJuYW1lIjoidXBwZXJfYm91bmRzIiwidHlwZSI6WyJudWxsIix7InR5cGUiOiJhcnJheSIsIml0ZW1zIjp7InR5cGUiOiJyZWNvcmQiLCJuYW1lIjoiazEyOV92MTMwIiwiZmllbGRzIjpbeyJuYW1lIjoia2V5IiwidHlwZSI6ImludCIsImZpZWxkLWlkIjoxMjl9LHsibmFtZSI6InZhbHVlIiwidHlwZSI6ImJ5dGVzIiwiZmllbGQtaWQiOjEzMH1dfSwibG9naWNhbFR5cGUiOiJtYXAifV0sImRvYyI6Ik1hcCBvZiBjb2x1bW4gaWQgdG8gdXBwZXIgYm91bmQiLCJkZWZhdWx0IjpudWxsLCJmaWVsZC1pZCI6MTI4fSx7Im5hbWUiOiJrZXlfbWV0YWRhdGEiLCJ0eXBlIjpbIm51bGwiLCJieXRlcyJdLCJkb2MiOiJFbmNyeXB0aW9uIGtleSBtZXRhZGF0YSBibG9iIiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjEzMX0seyJuYW1lIjoic3BsaXRfb2Zmc2V0cyIsInR5cGUiOlsibnVsbCIseyJ0eXBlIjoiYXJyYXkiLCJpdGVtcyI6ImxvbmciLCJlbGVtZW50LWlkIjoxMzN9XSwiZG9jIjoiU3BsaXR0YWJsZSBvZmZzZXRzIiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjEzMn0seyJuYW1lIjoiZXF1YWxpdHlfaWRzIiwidHlwZSI6WyJudWxsIix7InR5cGUiOiJhcnJheSIsIml0ZW1zIjoiaW50IiwiZWxlbWVudC1pZCI6MTM2fV0sImRvYyI6IkVxdWFsaXR5IGNvbXBhcmlzb24gZmllbGQgSURzIiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjEzNX0seyJuYW1lIjoic29ydF9vcmRlcl9pZCIsInR5cGUiOlsibnVsbCIsImludCJdLCJkb2MiOiJTb3J0IG9yZGVyIElEIiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjE0MH1dfSwiZmllbGQtaWQiOjJ9XX0UYXZyby5jb2RlYw5kZWZsYXRlHGZvcm1hdC12ZXJzaW9uAjIicGFydGl0aW9uLXNwZWMtaWQCMBxpY2ViZXJnLnNjaGVtYcoreyJ0eXBlIjoic3RydWN0Iiwic2NoZW1hLWlkIjowLCJmaWVsZHMiOlt7ImlkIjowLCJuYW1lIjoic3RhdHVzIiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJpbnQifSx7ImlkIjoxLCJuYW1lIjoic25hcHNob3RfaWQiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOiJsb25nIn0seyJpZCI6MywibmFtZSI6InNlcXVlbmNlX251bWJlciIsInJlcXVpcmVkIjpmYWxzZSwidHlwZSI6ImxvbmcifSx7ImlkIjo0LCJuYW1lIjoiZmlsZV9zZXF1ZW5jZV9udW1iZXIiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOiJsb25nIn0seyJpZCI6MiwibmFtZSI6ImRhdGFfZmlsZSIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjp7InR5cGUiOiJzdHJ1Y3QiLCJmaWVsZHMiOlt7ImlkIjoxMzQsIm5hbWUiOiJjb250ZW50IiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJpbnQiLCJkb2MiOiJDb250ZW50cyBvZiB0aGUgZmlsZTogMD1kYXRhLCAxPXBvc2l0aW9uIGRlbGV0ZXMsIDI9ZXF1YWxpdHkgZGVsZXRlcyJ9LHsiaWQiOjEwMCwibmFtZSI6ImZpbGVfcGF0aCIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjoic3RyaW5nIiwiZG9jIjoiTG9jYXRpb24gVVJJIHdpdGggRlMgc2NoZW1lIn0seyJpZCI6MTAxLCJuYW1lIjoiZmlsZV9mb3JtYXQiLCJyZXF1aXJlZCI6dHJ1ZSwidHlwZSI6InN0cmluZyIsImRvYyI6IkZpbGUgZm9ybWF0IG5hbWU6IGF2cm8sIG9yYywgb3IgcGFycXVldCJ9LHsiaWQiOjEwMiwibmFtZSI6InBhcnRpdGlvbiIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjp7InR5cGUiOiJzdHJ1Y3QiLCJmaWVsZHMiOltdfSwiZG9jIjoiUGFydGl0aW9uIGRhdGEgdHVwbGUsIHNjaGVtYSBiYXNlZCBvbiB0aGUgcGFydGl0aW9uIHNwZWMifSx7ImlkIjoxMDMsIm5hbWUiOiJyZWNvcmRfY291bnQiLCJyZXF1aXJlZCI6dHJ1ZSwidHlwZSI6ImxvbmciLCJkb2MiOiJOdW1iZXIgb2YgcmVjb3JkcyBpbiB0aGUgZmlsZSJ9LHsiaWQiOjEwNCwibmFtZSI6ImZpbGVfc2l6ZV9pbl9ieXRlcyIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjoibG9uZyIsImRvYyI6IlRvdGFsIGZpbGUgc2l6ZSBpbiBieXRlcyJ9LHsiaWQiOjEwOCwibmFtZSI6ImNvbHVtbl9zaXplcyIsInJlcXVpcmVkIjpmYWxzZSwidHlwZSI6eyJ0eXBlIjoibWFwIiwia2V5LWlkIjoxMTcsImtleSI6ImludCIsInZhbHVlLWlkIjoxMTgsInZhbHVlIjoibG9uZyIsInZhbHVlLXJlcXVpcmVkIjp0cnVlfSwiZG9jIjoiTWFwIG9mIGNvbHVtbiBpZCB0byB0b3RhbCBzaXplIG9uIGRpc2sifSx7ImlkIjoxMDksIm5hbWUiOiJ2YWx1ZV9jb3VudHMiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOnsidHlwZSI6Im1hcCIsImtleS1pZCI6MTE5LCJrZXkiOiJpbnQiLCJ2YWx1ZS1pZCI6MTIwLCJ2YWx1ZSI6ImxvbmciLCJ2YWx1ZS1yZXF1aXJlZCI6dHJ1ZX0sImRvYyI6Ik1hcCBvZiBjb2x1bW4gaWQgdG8gdG90YWwgY291bnQsIGluY2x1ZGluZyBudWxsIGFuZCBOYU4ifSx7ImlkIjoxMTAsIm5hbWUiOiJudWxsX3ZhbHVlX2NvdW50cyIsInJlcXVpcmVkIjpmYWxzZSwidHlwZSI6eyJ0eXBlIjoibWFwIiwia2V5LWlkIjoxMjEsImtleSI6ImludCIsInZhbHVlLWlkIjoxMjIsInZhbHVlIjoibG9uZyIsInZhbHVlLXJlcXVpcmVkIjp0cnVlfSwiZG9jIjoiTWFwIG9mIGNvbHVtbiBpZCB0byBudWxsIHZhbHVlIGNvdW50In0seyJpZCI6MTM3LCJuYW1lIjoibmFuX3ZhbHVlX2NvdW50cyIsInJlcXVpcmVkIjpmYWxzZSwidHlwZSI6eyJ0eXBlIjoibWFwIiwia2V5LWlkIjoxMzgsImtleSI6ImludCIsInZhbHVlLWlkIjoxMzksInZhbHVlIjoibG9uZyIsInZhbHVlLXJlcXVpcmVkIjp0cnVlfSwiZG9jIjoiTWFwIG9mIGNvbHVtbiBpZCB0byBudW1iZXIgb2YgTmFOIHZhbHVlcyBpbiB0aGUgY29sdW1uIn0seyJpZCI6MTI1LCJuYW1lIjoibG93ZXJfYm91bmRzIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjp7InR5cGUiOiJtYXAiLCJrZXktaWQiOjEyNiwia2V5IjoiaW50IiwidmFsdWUtaWQiOjEyNywidmFsdWUiOiJiaW5hcnkiLCJ2YWx1ZS1yZXF1aXJlZCI6dHJ1ZX0sImRvYyI6Ik1hcCBvZiBjb2x1bW4gaWQgdG8gbG93ZXIgYm91bmQifSx7ImlkIjoxMjgsIm5hbWUiOiJ1cHBlcl9ib3VuZHMiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOnsidHlwZSI6Im1hcCIsImtleS1pZCI6MTI5LCJrZXkiOiJpbnQiLCJ2YWx1ZS1pZCI6MTMwLCJ2YWx1ZSI6ImJpbmFyeSIsInZhbHVlLXJlcXVpcmVkIjp0cnVlfSwiZG9jIjoiTWFwIG9mIGNvbHVtbiBpZCB0byB1cHBlciBib3VuZCJ9LHsiaWQiOjEzMSwibmFtZSI6ImtleV9tZXRhZGF0YSIsInJlcXVpcmVkIjpmYWxzZSwidHlwZSI6ImJpbmFyeSIsImRvYyI6IkVuY3J5cHRpb24ga2V5IG1ldGFkYXRhIGJsb2IifSx7ImlkIjoxMzIsIm5hbWUiOiJzcGxpdF9vZmZzZXRzIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjp7InR5cGUiOiJsaXN0IiwiZWxlbWVudC1pZCI6MTMzLCJlbGVtZW50IjoibG9uZyIsImVsZW1lbnQtcmVxdWlyZWQiOnRydWV9LCJkb2MiOiJTcGxpdHRhYmxlIG9mZnNldHMifSx7ImlkIjoxMzUsIm5hbWUiOiJlcXVhbGl0eV9pZHMiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOnsidHlwZSI6Imxpc3QiLCJlbGVtZW50LWlkIjoxMzYsImVsZW1lbnQiOiJpbnQiLCJlbGVtZW50LXJlcXVpcmVkIjp0cnVlfSwiZG9jIjoiRXF1YWxpdHkgY29tcGFyaXNvbiBmaWVsZCBJRHMifSx7ImlkIjoxNDAsIm5hbWUiOiJzb3J0X29yZGVyX2lkIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoiaW50IiwiZG9jIjoiU29ydCBvcmRlciBJRCJ9XX19XX0ccGFydGl0aW9uLXNwZWMEW10OY29udGVudAhkYXRhAMa4rsHHfaK26SVRsXCn8LwCoAM1jDFOAzEQRb2OCyrgImbttb12GiQKekBQj7zjMYpkCUicK1ByASQOkJYbUG3BJTgDHIA4gle9Lz19zp+/338+v14/zhljO96vkCZa30OKNfaJctyW2lfaVEhUqBLkVaENDFAeMBYYwxAUagsabQCLOkD0NIEyyZB2zpnk+8OXakijpbMeDY5e+kGjtJMZZfQKpUfMWbkhRxVki/XZY1w/bakeX13cXN9d3s7dywkXfLcQbwu2l7kTc9eECcZ4k1P2h+D6sPF/i+Vy3/CjFv4Cxriuwcd9orbpJVGxcKfwvA== | base64 --decode > /iceberg_data/default/test_delete_files_2_local_68280c14_1c48_4c18_a7eb_03d3e15553d7/metadata/542b637b-0cae-4cda-a903-ab5fdd4b94e5-m0.avro] (cluster.py:121, run_and_check) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: m d o642 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: m d o643 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: m d o638 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: m d o640 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: m d o641 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: m d o631 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: m d o648 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: m d o653 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: m d o661 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: m d o667 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: m d o674 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: m d o679 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: m d o646 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : run container_id:rootteststorageiceberg-gw1-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p /iceberg_data/default/test_delete_files_2_local_68280c14_1c48_4c18_a7eb_03d3e15553d7/metadata'] (cluster.py:2045, exec_in_container) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command:[docker exec rootteststorageiceberg-gw1-node1-1 bash -c mkdir -p /iceberg_data/default/test_delete_files_2_local_68280c14_1c48_4c18_a7eb_03d3e15553d7/metadata] (cluster.py:121, run_and_check) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: m d o647 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: m d o649 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: m d o650 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: m d o651 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: m d o652 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: m d o654 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: m d o655 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: m d o656 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: m d o657 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: m d o658 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: m d o660 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: m d o662 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: m d o663 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: m d o664 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: m d o665 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: m d o666 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: m d o668 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: m d o669 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: m d o670 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: m d o671 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: m d o672 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: m d o673 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: m d o675 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: m d o676 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: m d o677 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: m d o678 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: m d o680 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: m d o681 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: m d o684 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command to send: m d o685 e (clientserver.py:501, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:52 [ 671 ] DEBUG : run container_id:rootteststorageiceberg-gw1-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname /iceberg_data/default/test_delete_files_2_local_68280c14_1c48_4c18_a7eb_03d3e15553d7/metadata/snap-2252423814036487363-1-542b637b-0cae-4cda-a903-ab5fdd4b94e5.avro) && echo T2JqAQ4WYXZyby5zY2hlbWGeHnsidHlwZSI6InJlY29yZCIsIm5hbWUiOiJtYW5pZmVzdF9maWxlIiwiZmllbGRzIjpbeyJuYW1lIjoibWFuaWZlc3RfcGF0aCIsInR5cGUiOiJzdHJpbmciLCJkb2MiOiJMb2NhdGlvbiBVUkkgd2l0aCBGUyBzY2hlbWUiLCJmaWVsZC1pZCI6NTAwfSx7Im5hbWUiOiJtYW5pZmVzdF9sZW5ndGgiLCJ0eXBlIjoibG9uZyIsImRvYyI6IlRvdGFsIGZpbGUgc2l6ZSBpbiBieXRlcyIsImZpZWxkLWlkIjo1MDF9LHsibmFtZSI6InBhcnRpdGlvbl9zcGVjX2lkIiwidHlwZSI6ImludCIsImRvYyI6IlNwZWMgSUQgdXNlZCB0byB3cml0ZSIsImZpZWxkLWlkIjo1MDJ9LHsibmFtZSI6ImNvbnRlbnQiLCJ0eXBlIjoiaW50IiwiZG9jIjoiQ29udGVudHMgb2YgdGhlIG1hbmlmZXN0OiAwPWRhdGEsIDE9ZGVsZXRlcyIsImZpZWxkLWlkIjo1MTd9LHsibmFtZSI6InNlcXVlbmNlX251bWJlciIsInR5cGUiOiJsb25nIiwiZG9jIjoiU2VxdWVuY2UgbnVtYmVyIHdoZW4gdGhlIG1hbmlmZXN0IHdhcyBhZGRlZCIsImZpZWxkLWlkIjo1MTV9LHsibmFtZSI6Im1pbl9zZXF1ZW5jZV9udW1iZXIiLCJ0eXBlIjoibG9uZyIsImRvYyI6Ikxvd2VzdCBzZXF1ZW5jZSBudW1iZXIgaW4gdGhlIG1hbmlmZXN0IiwiZmllbGQtaWQiOjUxNn0seyJuYW1lIjoiYWRkZWRfc25hcHNob3RfaWQiLCJ0eXBlIjoibG9uZyIsImRvYyI6IlNuYXBzaG90IElEIHRoYXQgYWRkZWQgdGhlIG1hbmlmZXN0IiwiZmllbGQtaWQiOjUwM30seyJuYW1lIjoiYWRkZWRfZGF0YV9maWxlc19jb3VudCIsInR5cGUiOiJpbnQiLCJkb2MiOiJBZGRlZCBlbnRyeSBjb3VudCIsImZpZWxkLWlkIjo1MDR9LHsibmFtZSI6ImV4aXN0aW5nX2RhdGFfZmlsZXNfY291bnQiLCJ0eXBlIjoiaW50IiwiZG9jIjoiRXhpc3RpbmcgZW50cnkgY291bnQiLCJmaWVsZC1pZCI6NTA1fSx7Im5hbWUiOiJkZWxldGVkX2RhdGFfZmlsZXNfY291bnQiLCJ0eXBlIjoiaW50IiwiZG9jIjoiRGVsZXRlZCBlbnRyeSBjb3VudCIsImZpZWxkLWlkIjo1MDZ9LHsibmFtZSI6ImFkZGVkX3Jvd3NfY291bnQiLCJ0eXBlIjoibG9uZyIsImRvYyI6IkFkZGVkIHJvd3MgY291bnQiLCJmaWVsZC1pZCI6NTEyfSx7Im5hbWUiOiJleGlzdGluZ19yb3dzX2NvdW50IiwidHlwZSI6ImxvbmciLCJkb2MiOiJFeGlzdGluZyByb3dzIGNvdW50IiwiZmllbGQtaWQiOjUxM30seyJuYW1lIjoiZGVsZXRlZF9yb3dzX2NvdW50IiwidHlwZSI6ImxvbmciLCJkb2MiOiJEZWxldGVkIHJvd3MgY291bnQiLCJmaWVsZC1pZCI6NTE0fSx7Im5hbWUiOiJwYXJ0aXRpb25zIiwidHlwZSI6WyJudWxsIix7InR5cGUiOiJhcnJheSIsIml0ZW1zIjp7InR5cGUiOiJyZWNvcmQiLCJuYW1lIjoicjUwOCIsImZpZWxkcyI6W3sibmFtZSI6ImNvbnRhaW5zX251bGwiLCJ0eXBlIjoiYm9vbGVhbiIsImRvYyI6IlRydWUgaWYgYW55IGZpbGUgaGFzIGEgbnVsbCBwYXJ0aXRpb24gdmFsdWUiLCJmaWVsZC1pZCI6NTA5fSx7Im5hbWUiOiJjb250YWluc19uYW4iLCJ0eXBlIjpbIm51bGwiLCJib29sZWFuIl0sImRvYyI6IlRydWUgaWYgYW55IGZpbGUgaGFzIGEgbmFuIHBhcnRpdGlvbiB2YWx1ZSIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjo1MTh9LHsibmFtZSI6Imxvd2VyX2JvdW5kIiwidHlwZSI6WyJudWxsIiwiYnl0ZXMiXSwiZG9jIjoiUGFydGl0aW9uIGxvd2VyIGJvdW5kIGZvciBhbGwgZmlsZXMiLCJkZWZhdWx0IjpudWxsLCJmaWVsZC1pZCI6NTEwfSx7Im5hbWUiOiJ1cHBlcl9ib3VuZCIsInR5cGUiOlsibnVsbCIsImJ5dGVzIl0sImRvYyI6IlBhcnRpdGlvbiB1cHBlciBib3VuZCBmb3IgYWxsIGZpbGVzIiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjUxMX1dfSwiZWxlbWVudC1pZCI6NTA4fV0sImRvYyI6IlN1bW1hcnkgZm9yIGVhY2ggcGFydGl0aW9uIiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjUwN31dfRRhdnJvLmNvZGVjDmRlZmxhdGUWc25hcHNob3QtaWQmMjI1MjQyMzgxNDAzNjQ4NzM2Mxxmb3JtYXQtdmVyc2lvbgIyHnNlcXVlbmNlLW51bWJlcgIxHGljZWJlcmcuc2NoZW1h1h97InR5cGUiOiJzdHJ1Y3QiLCJzY2hlbWEtaWQiOjAsImZpZWxkcyI6W3siaWQiOjUwMCwibmFtZSI6Im1hbmlmZXN0X3BhdGgiLCJyZXF1aXJlZCI6dHJ1ZSwidHlwZSI6InN0cmluZyIsImRvYyI6IkxvY2F0aW9uIFVSSSB3aXRoIEZTIHNjaGVtZSJ9LHsiaWQiOjUwMSwibmFtZSI6Im1hbmlmZXN0X2xlbmd0aCIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjoibG9uZyIsImRvYyI6IlRvdGFsIGZpbGUgc2l6ZSBpbiBieXRlcyJ9LHsiaWQiOjUwMiwibmFtZSI6InBhcnRpdGlvbl9zcGVjX2lkIiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJpbnQiLCJkb2MiOiJTcGVjIElEIHVzZWQgdG8gd3JpdGUifSx7ImlkIjo1MTcsIm5hbWUiOiJjb250ZW50IiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJpbnQiLCJkb2MiOiJDb250ZW50cyBvZiB0aGUgbWFuaWZlc3Q6IDA9ZGF0YSwgMT1kZWxldGVzIn0seyJpZCI6NTE1LCJuYW1lIjoic2VxdWVuY2VfbnVtYmVyIiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJsb25nIiwiZG9jIjoiU2VxdWVuY2UgbnVtYmVyIHdoZW4gdGhlIG1hbmlmZXN0IHdhcyBhZGRlZCJ9LHsiaWQiOjUxNiwibmFtZSI6Im1pbl9zZXF1ZW5jZV9udW1iZXIiLCJyZXF1aXJlZCI6dHJ1ZSwidHlwZSI6ImxvbmciLCJkb2MiOiJMb3dlc3Qgc2VxdWVuY2UgbnVtYmVyIGluIHRoZSBtYW5pZmVzdCJ9LHsiaWQiOjUwMywibmFtZSI6ImFkZGVkX3NuYXBzaG90X2lkIiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJsb25nIiwiZG9jIjoiU25hcHNob3QgSUQgdGhhdCBhZGRlZCB0aGUgbWFuaWZlc3QifSx7ImlkIjo1MDQsIm5hbWUiOiJhZGRlZF9kYXRhX2ZpbGVzX2NvdW50IiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJpbnQiLCJkb2MiOiJBZGRlZCBlbnRyeSBjb3VudCJ9LHsiaWQiOjUwNSwibmFtZSI6ImV4aXN0aW5nX2RhdGFfZmlsZXNfY291bnQiLCJyZXF1aXJlZCI6dHJ1ZSwidHlwZSI6ImludCIsImRvYyI6IkV4aXN0aW5nIGVudHJ5IGNvdW50In0seyJpZCI6NTA2LCJuYW1lIjoiZGVsZXRlZF9kYXRhX2ZpbGVzX2NvdW50IiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJpbnQiLCJkb2MiOiJEZWxldGVkIGVudHJ5IGNvdW50In0seyJpZCI6NTEyLCJuYW1lIjoiYWRkZWRfcm93c19jb3VudCIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjoibG9uZyIsImRvYyI6IkFkZGVkIHJvd3MgY291bnQifSx7ImlkIjo1MTMsIm5hbWUiOiJleGlzdGluZ19yb3dzX2NvdW50IiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJsb25nIiwiZG9jIjoiRXhpc3Rpbmcgcm93cyBjb3VudCJ9LHsiaWQiOjUxNCwibmFtZSI6ImRlbGV0ZWRfcm93c19jb3VudCIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjoibG9uZyIsImRvYyI6IkRlbGV0ZWQgcm93cyBjb3VudCJ9LHsiaWQiOjUwNywibmFtZSI6InBhcnRpdGlvbnMiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOnsidHlwZSI6Imxpc3QiLCJlbGVtZW50LWlkIjo1MDgsImVsZW1lbnQiOnsidHlwZSI6InN0cnVjdCIsImZpZWxkcyI6W3siaWQiOjUwOSwibmFtZSI6ImNvbnRhaW5zX251bGwiLCJyZXF1aXJlZCI6dHJ1ZSwidHlwZSI6ImJvb2xlYW4iLCJkb2MiOiJUcnVlIGlmIGFueSBmaWxlIGhhcyBhIG51bGwgcGFydGl0aW9uIHZhbHVlIn0seyJpZCI6NTE4LCJuYW1lIjoiY29udGFpbnNfbmFuIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoiYm9vbGVhbiIsImRvYyI6IlRydWUgaWYgYW55IGZpbGUgaGFzIGEgbmFuIHBhcnRpdGlvbiB2YWx1ZSJ9LHsiaWQiOjUxMCwibmFtZSI6Imxvd2VyX2JvdW5kIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoiYmluYXJ5IiwiZG9jIjoiUGFydGl0aW9uIGxvd2VyIGJvdW5kIGZvciBhbGwgZmlsZXMifSx7ImlkIjo1MTEsIm5hbWUiOiJ1cHBlcl9ib3VuZCIsInJlcXVpcmVkIjpmYWxzZSwidHlwZSI6ImJpbmFyeSIsImRvYyI6IlBhcnRpdGlvbiB1cHBlciBib3VuZCBmb3IgYWxsIGZpbGVzIn1dfSwiZWxlbWVudC1yZXF1aXJlZCI6dHJ1ZX0sImRvYyI6IlN1bW1hcnkgZm9yIGVhY2ggcGFydGl0aW9uIn1dfSRwYXJlbnQtc25hcHNob3QtaWQIbnVsbAA8RlR6A9HaxHDw/xMT52DhAqoCHczBDcIgFABQZB8ECrT04io/H/6vNqFpYtERnMCbY7iBJw8u4QYmOoDG6zu8s9Rj5sT7LRBW1MQDHkrVlZcKxIUrwzAWXqCBMmcs0MYmmmw92Owj+GwjYMcJjCPHNoTgqNMTV/x/wTepdV1SJiMrnwkV9sYpTGEg8qn3HNRk1njcz6+dEFKe3tfP43m5baQQ99VPxBc8RlR6A9HaxHDw/xMT52Dh | base64 --decode > /iceberg_data/default/test_delete_files_2_local_68280c14_1c48_4c18_a7eb_03d3e15553d7/metadata/snap-2252423814036487363-1-542b637b-0cae-4cda-a903-ab5fdd4b94e5.avro'] (cluster.py:2045, exec_in_container) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command:[docker exec rootteststorageiceberg-gw1-node1-1 bash -c mkdir -p $(dirname /iceberg_data/default/test_delete_files_2_local_68280c14_1c48_4c18_a7eb_03d3e15553d7/metadata/snap-2252423814036487363-1-542b637b-0cae-4cda-a903-ab5fdd4b94e5.avro) && echo T2JqAQ4WYXZyby5zY2hlbWGeHnsidHlwZSI6InJlY29yZCIsIm5hbWUiOiJtYW5pZmVzdF9maWxlIiwiZmllbGRzIjpbeyJuYW1lIjoibWFuaWZlc3RfcGF0aCIsInR5cGUiOiJzdHJpbmciLCJkb2MiOiJMb2NhdGlvbiBVUkkgd2l0aCBGUyBzY2hlbWUiLCJmaWVsZC1pZCI6NTAwfSx7Im5hbWUiOiJtYW5pZmVzdF9sZW5ndGgiLCJ0eXBlIjoibG9uZyIsImRvYyI6IlRvdGFsIGZpbGUgc2l6ZSBpbiBieXRlcyIsImZpZWxkLWlkIjo1MDF9LHsibmFtZSI6InBhcnRpdGlvbl9zcGVjX2lkIiwidHlwZSI6ImludCIsImRvYyI6IlNwZWMgSUQgdXNlZCB0byB3cml0ZSIsImZpZWxkLWlkIjo1MDJ9LHsibmFtZSI6ImNvbnRlbnQiLCJ0eXBlIjoiaW50IiwiZG9jIjoiQ29udGVudHMgb2YgdGhlIG1hbmlmZXN0OiAwPWRhdGEsIDE9ZGVsZXRlcyIsImZpZWxkLWlkIjo1MTd9LHsibmFtZSI6InNlcXVlbmNlX251bWJlciIsInR5cGUiOiJsb25nIiwiZG9jIjoiU2VxdWVuY2UgbnVtYmVyIHdoZW4gdGhlIG1hbmlmZXN0IHdhcyBhZGRlZCIsImZpZWxkLWlkIjo1MTV9LHsibmFtZSI6Im1pbl9zZXF1ZW5jZV9udW1iZXIiLCJ0eXBlIjoibG9uZyIsImRvYyI6Ikxvd2VzdCBzZXF1ZW5jZSBudW1iZXIgaW4gdGhlIG1hbmlmZXN0IiwiZmllbGQtaWQiOjUxNn0seyJuYW1lIjoiYWRkZWRfc25hcHNob3RfaWQiLCJ0eXBlIjoibG9uZyIsImRvYyI6IlNuYXBzaG90IElEIHRoYXQgYWRkZWQgdGhlIG1hbmlmZXN0IiwiZmllbGQtaWQiOjUwM30seyJuYW1lIjoiYWRkZWRfZGF0YV9maWxlc19jb3VudCIsInR5cGUiOiJpbnQiLCJkb2MiOiJBZGRlZCBlbnRyeSBjb3VudCIsImZpZWxkLWlkIjo1MDR9LHsibmFtZSI6ImV4aXN0aW5nX2RhdGFfZmlsZXNfY291bnQiLCJ0eXBlIjoiaW50IiwiZG9jIjoiRXhpc3RpbmcgZW50cnkgY291bnQiLCJmaWVsZC1pZCI6NTA1fSx7Im5hbWUiOiJkZWxldGVkX2RhdGFfZmlsZXNfY291bnQiLCJ0eXBlIjoiaW50IiwiZG9jIjoiRGVsZXRlZCBlbnRyeSBjb3VudCIsImZpZWxkLWlkIjo1MDZ9LHsibmFtZSI6ImFkZGVkX3Jvd3NfY291bnQiLCJ0eXBlIjoibG9uZyIsImRvYyI6IkFkZGVkIHJvd3MgY291bnQiLCJmaWVsZC1pZCI6NTEyfSx7Im5hbWUiOiJleGlzdGluZ19yb3dzX2NvdW50IiwidHlwZSI6ImxvbmciLCJkb2MiOiJFeGlzdGluZyByb3dzIGNvdW50IiwiZmllbGQtaWQiOjUxM30seyJuYW1lIjoiZGVsZXRlZF9yb3dzX2NvdW50IiwidHlwZSI6ImxvbmciLCJkb2MiOiJEZWxldGVkIHJvd3MgY291bnQiLCJmaWVsZC1pZCI6NTE0fSx7Im5hbWUiOiJwYXJ0aXRpb25zIiwidHlwZSI6WyJudWxsIix7InR5cGUiOiJhcnJheSIsIml0ZW1zIjp7InR5cGUiOiJyZWNvcmQiLCJuYW1lIjoicjUwOCIsImZpZWxkcyI6W3sibmFtZSI6ImNvbnRhaW5zX251bGwiLCJ0eXBlIjoiYm9vbGVhbiIsImRvYyI6IlRydWUgaWYgYW55IGZpbGUgaGFzIGEgbnVsbCBwYXJ0aXRpb24gdmFsdWUiLCJmaWVsZC1pZCI6NTA5fSx7Im5hbWUiOiJjb250YWluc19uYW4iLCJ0eXBlIjpbIm51bGwiLCJib29sZWFuIl0sImRvYyI6IlRydWUgaWYgYW55IGZpbGUgaGFzIGEgbmFuIHBhcnRpdGlvbiB2YWx1ZSIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjo1MTh9LHsibmFtZSI6Imxvd2VyX2JvdW5kIiwidHlwZSI6WyJudWxsIiwiYnl0ZXMiXSwiZG9jIjoiUGFydGl0aW9uIGxvd2VyIGJvdW5kIGZvciBhbGwgZmlsZXMiLCJkZWZhdWx0IjpudWxsLCJmaWVsZC1pZCI6NTEwfSx7Im5hbWUiOiJ1cHBlcl9ib3VuZCIsInR5cGUiOlsibnVsbCIsImJ5dGVzIl0sImRvYyI6IlBhcnRpdGlvbiB1cHBlciBib3VuZCBmb3IgYWxsIGZpbGVzIiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjUxMX1dfSwiZWxlbWVudC1pZCI6NTA4fV0sImRvYyI6IlN1bW1hcnkgZm9yIGVhY2ggcGFydGl0aW9uIiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjUwN31dfRRhdnJvLmNvZGVjDmRlZmxhdGUWc25hcHNob3QtaWQmMjI1MjQyMzgxNDAzNjQ4NzM2Mxxmb3JtYXQtdmVyc2lvbgIyHnNlcXVlbmNlLW51bWJlcgIxHGljZWJlcmcuc2NoZW1h1h97InR5cGUiOiJzdHJ1Y3QiLCJzY2hlbWEtaWQiOjAsImZpZWxkcyI6W3siaWQiOjUwMCwibmFtZSI6Im1hbmlmZXN0X3BhdGgiLCJyZXF1aXJlZCI6dHJ1ZSwidHlwZSI6InN0cmluZyIsImRvYyI6IkxvY2F0aW9uIFVSSSB3aXRoIEZTIHNjaGVtZSJ9LHsiaWQiOjUwMSwibmFtZSI6Im1hbmlmZXN0X2xlbmd0aCIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjoibG9uZyIsImRvYyI6IlRvdGFsIGZpbGUgc2l6ZSBpbiBieXRlcyJ9LHsiaWQiOjUwMiwibmFtZSI6InBhcnRpdGlvbl9zcGVjX2lkIiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJpbnQiLCJkb2MiOiJTcGVjIElEIHVzZWQgdG8gd3JpdGUifSx7ImlkIjo1MTcsIm5hbWUiOiJjb250ZW50IiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJpbnQiLCJkb2MiOiJDb250ZW50cyBvZiB0aGUgbWFuaWZlc3Q6IDA9ZGF0YSwgMT1kZWxldGVzIn0seyJpZCI6NTE1LCJuYW1lIjoic2VxdWVuY2VfbnVtYmVyIiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJsb25nIiwiZG9jIjoiU2VxdWVuY2UgbnVtYmVyIHdoZW4gdGhlIG1hbmlmZXN0IHdhcyBhZGRlZCJ9LHsiaWQiOjUxNiwibmFtZSI6Im1pbl9zZXF1ZW5jZV9udW1iZXIiLCJyZXF1aXJlZCI6dHJ1ZSwidHlwZSI6ImxvbmciLCJkb2MiOiJMb3dlc3Qgc2VxdWVuY2UgbnVtYmVyIGluIHRoZSBtYW5pZmVzdCJ9LHsiaWQiOjUwMywibmFtZSI6ImFkZGVkX3NuYXBzaG90X2lkIiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJsb25nIiwiZG9jIjoiU25hcHNob3QgSUQgdGhhdCBhZGRlZCB0aGUgbWFuaWZlc3QifSx7ImlkIjo1MDQsIm5hbWUiOiJhZGRlZF9kYXRhX2ZpbGVzX2NvdW50IiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJpbnQiLCJkb2MiOiJBZGRlZCBlbnRyeSBjb3VudCJ9LHsiaWQiOjUwNSwibmFtZSI6ImV4aXN0aW5nX2RhdGFfZmlsZXNfY291bnQiLCJyZXF1aXJlZCI6dHJ1ZSwidHlwZSI6ImludCIsImRvYyI6IkV4aXN0aW5nIGVudHJ5IGNvdW50In0seyJpZCI6NTA2LCJuYW1lIjoiZGVsZXRlZF9kYXRhX2ZpbGVzX2NvdW50IiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJpbnQiLCJkb2MiOiJEZWxldGVkIGVudHJ5IGNvdW50In0seyJpZCI6NTEyLCJuYW1lIjoiYWRkZWRfcm93c19jb3VudCIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjoibG9uZyIsImRvYyI6IkFkZGVkIHJvd3MgY291bnQifSx7ImlkIjo1MTMsIm5hbWUiOiJleGlzdGluZ19yb3dzX2NvdW50IiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJsb25nIiwiZG9jIjoiRXhpc3Rpbmcgcm93cyBjb3VudCJ9LHsiaWQiOjUxNCwibmFtZSI6ImRlbGV0ZWRfcm93c19jb3VudCIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjoibG9uZyIsImRvYyI6IkRlbGV0ZWQgcm93cyBjb3VudCJ9LHsiaWQiOjUwNywibmFtZSI6InBhcnRpdGlvbnMiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOnsidHlwZSI6Imxpc3QiLCJlbGVtZW50LWlkIjo1MDgsImVsZW1lbnQiOnsidHlwZSI6InN0cnVjdCIsImZpZWxkcyI6W3siaWQiOjUwOSwibmFtZSI6ImNvbnRhaW5zX251bGwiLCJyZXF1aXJlZCI6dHJ1ZSwidHlwZSI6ImJvb2xlYW4iLCJkb2MiOiJUcnVlIGlmIGFueSBmaWxlIGhhcyBhIG51bGwgcGFydGl0aW9uIHZhbHVlIn0seyJpZCI6NTE4LCJuYW1lIjoiY29udGFpbnNfbmFuIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoiYm9vbGVhbiIsImRvYyI6IlRydWUgaWYgYW55IGZpbGUgaGFzIGEgbmFuIHBhcnRpdGlvbiB2YWx1ZSJ9LHsiaWQiOjUxMCwibmFtZSI6Imxvd2VyX2JvdW5kIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoiYmluYXJ5IiwiZG9jIjoiUGFydGl0aW9uIGxvd2VyIGJvdW5kIGZvciBhbGwgZmlsZXMifSx7ImlkIjo1MTEsIm5hbWUiOiJ1cHBlcl9ib3VuZCIsInJlcXVpcmVkIjpmYWxzZSwidHlwZSI6ImJpbmFyeSIsImRvYyI6IlBhcnRpdGlvbiB1cHBlciBib3VuZCBmb3IgYWxsIGZpbGVzIn1dfSwiZWxlbWVudC1yZXF1aXJlZCI6dHJ1ZX0sImRvYyI6IlN1bW1hcnkgZm9yIGVhY2ggcGFydGl0aW9uIn1dfSRwYXJlbnQtc25hcHNob3QtaWQIbnVsbAA8RlR6A9HaxHDw/xMT52DhAqoCHczBDcIgFABQZB8ECrT04io/H/6vNqFpYtERnMCbY7iBJw8u4QYmOoDG6zu8s9Rj5sT7LRBW1MQDHkrVlZcKxIUrwzAWXqCBMmcs0MYmmmw92Owj+GwjYMcJjCPHNoTgqNMTV/x/wTepdV1SJiMrnwkV9sYpTGEg8qn3HNRk1njcz6+dEFKe3tfP43m5baQQ99VPxBc8RlR6A9HaxHDw/xMT52Dh | base64 --decode > /iceberg_data/default/test_delete_files_2_local_68280c14_1c48_4c18_a7eb_03d3e15553d7/metadata/snap-2252423814036487363-1-542b637b-0cae-4cda-a903-ab5fdd4b94e5.avro] (cluster.py:121, run_and_check) 2025-05-23 21:10:52 [ 671 ] DEBUG : run container_id:rootteststorageiceberg-gw1-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p /iceberg_data/default/test_delete_files_2_local_68280c14_1c48_4c18_a7eb_03d3e15553d7/metadata'] (cluster.py:2045, exec_in_container) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command:[docker exec rootteststorageiceberg-gw1-node1-1 bash -c mkdir -p /iceberg_data/default/test_delete_files_2_local_68280c14_1c48_4c18_a7eb_03d3e15553d7/metadata] (cluster.py:121, run_and_check) 2025-05-23 21:10:52 [ 671 ] DEBUG : run container_id:rootteststorageiceberg-gw1-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname /iceberg_data/default/test_delete_files_2_local_68280c14_1c48_4c18_a7eb_03d3e15553d7/metadata/version-hint.text) && echo MQ== | base64 --decode > /iceberg_data/default/test_delete_files_2_local_68280c14_1c48_4c18_a7eb_03d3e15553d7/metadata/version-hint.text'] (cluster.py:2045, exec_in_container) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command:[docker exec rootteststorageiceberg-gw1-node1-1 bash -c mkdir -p $(dirname /iceberg_data/default/test_delete_files_2_local_68280c14_1c48_4c18_a7eb_03d3e15553d7/metadata/version-hint.text) && echo MQ== | base64 --decode > /iceberg_data/default/test_delete_files_2_local_68280c14_1c48_4c18_a7eb_03d3e15553d7/metadata/version-hint.text] (cluster.py:121, run_and_check) 2025-05-23 21:10:52 [ 671 ] DEBUG : run container_id:rootteststorageiceberg-gw1-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p /iceberg_data/default/test_delete_files_2_local_68280c14_1c48_4c18_a7eb_03d3e15553d7/metadata'] (cluster.py:2045, exec_in_container) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command:[docker exec rootteststorageiceberg-gw1-node1-1 bash -c mkdir -p /iceberg_data/default/test_delete_files_2_local_68280c14_1c48_4c18_a7eb_03d3e15553d7/metadata] (cluster.py:121, run_and_check) 2025-05-23 21:10:52 [ 671 ] DEBUG : run container_id:rootteststorageiceberg-gw1-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname /iceberg_data/default/test_delete_files_2_local_68280c14_1c48_4c18_a7eb_03d3e15553d7/metadata/v1.metadata.json) && echo ewogICJmb3JtYXQtdmVyc2lvbiIgOiAyLAogICJ0YWJsZS11dWlkIiA6ICJkNWI5MDU2Yi1jM2ZiLTRkMmYtOTcxNS1jNmU4ODljYzhjMzQiLAogICJsb2NhdGlvbiIgOiAiL2ljZWJlcmdfZGF0YS9kZWZhdWx0L3Rlc3RfZGVsZXRlX2ZpbGVzXzJfbG9jYWxfNjgyODBjMTRfMWM0OF80YzE4X2E3ZWJfMDNkM2UxNTU1M2Q3IiwKICAibGFzdC1zZXF1ZW5jZS1udW1iZXIiIDogMSwKICAibGFzdC11cGRhdGVkLW1zIiA6IDE3NDgwMzQ2NTIyNTMsCiAgImxhc3QtY29sdW1uLWlkIiA6IDIsCiAgImN1cnJlbnQtc2NoZW1hLWlkIiA6IDAsCiAgInNjaGVtYXMiIDogWyB7CiAgICAidHlwZSIgOiAic3RydWN0IiwKICAgICJzY2hlbWEtaWQiIDogMCwKICAgICJmaWVsZHMiIDogWyB7CiAgICAgICJpZCIgOiAxLAogICAgICAibmFtZSIgOiAiYSIsCiAgICAgICJyZXF1aXJlZCIgOiBmYWxzZSwKICAgICAgInR5cGUiIDogImxvbmciCiAgICB9LCB7CiAgICAgICJpZCIgOiAyLAogICAgICAibmFtZSIgOiAiYiIsCiAgICAgICJyZXF1aXJlZCIgOiBmYWxzZSwKICAgICAgInR5cGUiIDogInN0cmluZyIKICAgIH0gXQogIH0gXSwKICAiZGVmYXVsdC1zcGVjLWlkIiA6IDAsCiAgInBhcnRpdGlvbi1zcGVjcyIgOiBbIHsKICAgICJzcGVjLWlkIiA6IDAsCiAgICAiZmllbGRzIiA6IFsgXQogIH0gXSwKICAibGFzdC1wYXJ0aXRpb24taWQiIDogOTk5LAogICJkZWZhdWx0LXNvcnQtb3JkZXItaWQiIDogMCwKICAic29ydC1vcmRlcnMiIDogWyB7CiAgICAib3JkZXItaWQiIDogMCwKICAgICJmaWVsZHMiIDogWyBdCiAgfSBdLAogICJwcm9wZXJ0aWVzIiA6IHsKICAgICJvd25lciIgOiAicm9vdCIKICB9LAogICJjdXJyZW50LXNuYXBzaG90LWlkIiA6IDIyNTI0MjM4MTQwMzY0ODczNjMsCiAgInJlZnMiIDogewogICAgIm1haW4iIDogewogICAgICAic25hcHNob3QtaWQiIDogMjI1MjQyMzgxNDAzNjQ4NzM2MywKICAgICAgInR5cGUiIDogImJyYW5jaCIKICAgIH0KICB9LAogICJzbmFwc2hvdHMiIDogWyB7CiAgICAic2VxdWVuY2UtbnVtYmVyIiA6IDEsCiAgICAic25hcHNob3QtaWQiIDogMjI1MjQyMzgxNDAzNjQ4NzM2MywKICAgICJ0aW1lc3RhbXAtbXMiIDogMTc0ODAzNDY1MjI1MywKICAgICJzdW1tYXJ5IiA6IHsKICAgICAgIm9wZXJhdGlvbiIgOiAiYXBwZW5kIiwKICAgICAgInNwYXJrLmFwcC5pZCIgOiAibG9jYWwtMTc0ODAzNDYzNjQzMiIsCiAgICAgICJhZGRlZC1kYXRhLWZpbGVzIiA6ICIxIiwKICAgICAgImFkZGVkLXJlY29yZHMiIDogIjEwMCIsCiAgICAgICJhZGRlZC1maWxlcy1zaXplIiA6ICI5NjciLAogICAgICAiY2hhbmdlZC1wYXJ0aXRpb24tY291bnQiIDogIjEiLAogICAgICAidG90YWwtcmVjb3JkcyIgOiAiMTAwIiwKICAgICAgInRvdGFsLWZpbGVzLXNpemUiIDogIjk2NyIsCiAgICAgICJ0b3RhbC1kYXRhLWZpbGVzIiA6ICIxIiwKICAgICAgInRvdGFsLWRlbGV0ZS1maWxlcyIgOiAiMCIsCiAgICAgICJ0b3RhbC1wb3NpdGlvbi1kZWxldGVzIiA6ICIwIiwKICAgICAgInRvdGFsLWVxdWFsaXR5LWRlbGV0ZXMiIDogIjAiCiAgICB9LAogICAgIm1hbmlmZXN0LWxpc3QiIDogIi9pY2ViZXJnX2RhdGEvZGVmYXVsdC90ZXN0X2RlbGV0ZV9maWxlc18yX2xvY2FsXzY4MjgwYzE0XzFjNDhfNGMxOF9hN2ViXzAzZDNlMTU1NTNkNy9tZXRhZGF0YS9zbmFwLTIyNTI0MjM4MTQwMzY0ODczNjMtMS01NDJiNjM3Yi0wY2FlLTRjZGEtYTkwMy1hYjVmZGQ0Yjk0ZTUuYXZybyIsCiAgICAic2NoZW1hLWlkIiA6IDAKICB9IF0sCiAgInN0YXRpc3RpY3MiIDogWyBdLAogICJzbmFwc2hvdC1sb2ciIDogWyB7CiAgICAidGltZXN0YW1wLW1zIiA6IDE3NDgwMzQ2NTIyNTMsCiAgICAic25hcHNob3QtaWQiIDogMjI1MjQyMzgxNDAzNjQ4NzM2MwogIH0gXSwKICAibWV0YWRhdGEtbG9nIiA6IFsgXQp9 | base64 --decode > /iceberg_data/default/test_delete_files_2_local_68280c14_1c48_4c18_a7eb_03d3e15553d7/metadata/v1.metadata.json'] (cluster.py:2045, exec_in_container) 2025-05-23 21:10:52 [ 671 ] DEBUG : Command:[docker exec rootteststorageiceberg-gw1-node1-1 bash -c mkdir -p $(dirname /iceberg_data/default/test_delete_files_2_local_68280c14_1c48_4c18_a7eb_03d3e15553d7/metadata/v1.metadata.json) && echo ewogICJmb3JtYXQtdmVyc2lvbiIgOiAyLAogICJ0YWJsZS11dWlkIiA6ICJkNWI5MDU2Yi1jM2ZiLTRkMmYtOTcxNS1jNmU4ODljYzhjMzQiLAogICJsb2NhdGlvbiIgOiAiL2ljZWJlcmdfZGF0YS9kZWZhdWx0L3Rlc3RfZGVsZXRlX2ZpbGVzXzJfbG9jYWxfNjgyODBjMTRfMWM0OF80YzE4X2E3ZWJfMDNkM2UxNTU1M2Q3IiwKICAibGFzdC1zZXF1ZW5jZS1udW1iZXIiIDogMSwKICAibGFzdC11cGRhdGVkLW1zIiA6IDE3NDgwMzQ2NTIyNTMsCiAgImxhc3QtY29sdW1uLWlkIiA6IDIsCiAgImN1cnJlbnQtc2NoZW1hLWlkIiA6IDAsCiAgInNjaGVtYXMiIDogWyB7CiAgICAidHlwZSIgOiAic3RydWN0IiwKICAgICJzY2hlbWEtaWQiIDogMCwKICAgICJmaWVsZHMiIDogWyB7CiAgICAgICJpZCIgOiAxLAogICAgICAibmFtZSIgOiAiYSIsCiAgICAgICJyZXF1aXJlZCIgOiBmYWxzZSwKICAgICAgInR5cGUiIDogImxvbmciCiAgICB9LCB7CiAgICAgICJpZCIgOiAyLAogICAgICAibmFtZSIgOiAiYiIsCiAgICAgICJyZXF1aXJlZCIgOiBmYWxzZSwKICAgICAgInR5cGUiIDogInN0cmluZyIKICAgIH0gXQogIH0gXSwKICAiZGVmYXVsdC1zcGVjLWlkIiA6IDAsCiAgInBhcnRpdGlvbi1zcGVjcyIgOiBbIHsKICAgICJzcGVjLWlkIiA6IDAsCiAgICAiZmllbGRzIiA6IFsgXQogIH0gXSwKICAibGFzdC1wYXJ0aXRpb24taWQiIDogOTk5LAogICJkZWZhdWx0LXNvcnQtb3JkZXItaWQiIDogMCwKICAic29ydC1vcmRlcnMiIDogWyB7CiAgICAib3JkZXItaWQiIDogMCwKICAgICJmaWVsZHMiIDogWyBdCiAgfSBdLAogICJwcm9wZXJ0aWVzIiA6IHsKICAgICJvd25lciIgOiAicm9vdCIKICB9LAogICJjdXJyZW50LXNuYXBzaG90LWlkIiA6IDIyNTI0MjM4MTQwMzY0ODczNjMsCiAgInJlZnMiIDogewogICAgIm1haW4iIDogewogICAgICAic25hcHNob3QtaWQiIDogMjI1MjQyMzgxNDAzNjQ4NzM2MywKICAgICAgInR5cGUiIDogImJyYW5jaCIKICAgIH0KICB9LAogICJzbmFwc2hvdHMiIDogWyB7CiAgICAic2VxdWVuY2UtbnVtYmVyIiA6IDEsCiAgICAic25hcHNob3QtaWQiIDogMjI1MjQyMzgxNDAzNjQ4NzM2MywKICAgICJ0aW1lc3RhbXAtbXMiIDogMTc0ODAzNDY1MjI1MywKICAgICJzdW1tYXJ5IiA6IHsKICAgICAgIm9wZXJhdGlvbiIgOiAiYXBwZW5kIiwKICAgICAgInNwYXJrLmFwcC5pZCIgOiAibG9jYWwtMTc0ODAzNDYzNjQzMiIsCiAgICAgICJhZGRlZC1kYXRhLWZpbGVzIiA6ICIxIiwKICAgICAgImFkZGVkLXJlY29yZHMiIDogIjEwMCIsCiAgICAgICJhZGRlZC1maWxlcy1zaXplIiA6ICI5NjciLAogICAgICAiY2hhbmdlZC1wYXJ0aXRpb24tY291bnQiIDogIjEiLAogICAgICAidG90YWwtcmVjb3JkcyIgOiAiMTAwIiwKICAgICAgInRvdGFsLWZpbGVzLXNpemUiIDogIjk2NyIsCiAgICAgICJ0b3RhbC1kYXRhLWZpbGVzIiA6ICIxIiwKICAgICAgInRvdGFsLWRlbGV0ZS1maWxlcyIgOiAiMCIsCiAgICAgICJ0b3RhbC1wb3NpdGlvbi1kZWxldGVzIiA6ICIwIiwKICAgICAgInRvdGFsLWVxdWFsaXR5LWRlbGV0ZXMiIDogIjAiCiAgICB9LAogICAgIm1hbmlmZXN0LWxpc3QiIDogIi9pY2ViZXJnX2RhdGEvZGVmYXVsdC90ZXN0X2RlbGV0ZV9maWxlc18yX2xvY2FsXzY4MjgwYzE0XzFjNDhfNGMxOF9hN2ViXzAzZDNlMTU1NTNkNy9tZXRhZGF0YS9zbmFwLTIyNTI0MjM4MTQwMzY0ODczNjMtMS01NDJiNjM3Yi0wY2FlLTRjZGEtYTkwMy1hYjVmZGQ0Yjk0ZTUuYXZybyIsCiAgICAic2NoZW1hLWlkIiA6IDAKICB9IF0sCiAgInN0YXRpc3RpY3MiIDogWyBdLAogICJzbmFwc2hvdC1sb2ciIDogWyB7CiAgICAidGltZXN0YW1wLW1zIiA6IDE3NDgwMzQ2NTIyNTMsCiAgICAic25hcHNob3QtaWQiIDogMjI1MjQyMzgxNDAzNjQ4NzM2MwogIH0gXSwKICAibWV0YWRhdGEtbG9nIiA6IFsgXQp9 | base64 --decode > /iceberg_data/default/test_delete_files_2_local_68280c14_1c48_4c18_a7eb_03d3e15553d7/metadata/v1.metadata.json] (cluster.py:121, run_and_check) 2025-05-23 21:10:52 [ 671 ] DEBUG : Executing query DROP TABLE IF EXISTS test_delete_files_2_local_68280c14_1c48_4c18_a7eb_03d3e15553d7 SYNC on node1 (cluster.py:3570, query) 2025-05-23 21:10:52 [ 671 ] DEBUG : Executing query DROP TABLE IF EXISTS test_delete_files_2_local_68280c14_1c48_4c18_a7eb_03d3e15553d7; CREATE TABLE test_delete_files_2_local_68280c14_1c48_4c18_a7eb_03d3e15553d7 ENGINE=IcebergLocal(local, path = '/iceberg_data/default/test_delete_files_2_local_68280c14_1c48_4c18_a7eb_03d3e15553d7/', format=Parquet) on node1 (cluster.py:3570, query) 2025-05-23 21:10:52 [ 671 ] DEBUG : Executing query SELECT count() FROM test_delete_files_2_local_68280c14_1c48_4c18_a7eb_03d3e15553d7 on node1 (cluster.py:3570, query) 2025-05-23 21:10:52 [ 671 ] DEBUG : Executing query SYSTEM FLUSH LOGS on node1 (cluster.py:3570, query) 2025-05-23 21:10:53 [ 671 ] DEBUG : Executing query SELECT ProfileEvents['IcebergTrivialCountOptimizationApplied'] FROM system.query_log where query_id = 'test_trivial_count_09182a98_502f_4f5b_bd9e_c08c56d6774a' and type = 'QueryFinish' on node1 (cluster.py:3570, query) ___________________________ test_delete_files[s3-1] ____________________________ [gw1] linux -- Python 3.10.12 /usr/bin/python3 started_cluster = format_version = '1', storage_type = 's3' @pytest.mark.parametrize("format_version", ["1", "2"]) @pytest.mark.parametrize("storage_type", ["s3", "azure", "local"]) def test_delete_files(started_cluster, format_version, storage_type): instance = started_cluster.instances["node1"] spark = started_cluster.spark_session TABLE_NAME = ( "test_delete_files_" + format_version + "_" + storage_type + "_" + get_uuid_str() ) write_iceberg_from_df( spark, generate_data(spark, 0, 100), TABLE_NAME, mode="overwrite", format_version=format_version, ) default_upload_directory( started_cluster, storage_type, f"/iceberg_data/default/{TABLE_NAME}/", f"/iceberg_data/default/{TABLE_NAME}/", ) create_iceberg_table(storage_type, instance, TABLE_NAME, started_cluster) # Test trivial count with deleted files query_id = "test_trivial_count_" + get_uuid_str() assert int(instance.query(f"SELECT count() FROM {TABLE_NAME}", query_id=query_id)) == 100 instance.query("SYSTEM FLUSH LOGS") > assert instance.query(f"SELECT ProfileEvents['IcebergTrivialCountOptimizationApplied'] FROM system.query_log where query_id = '{query_id}' and type = 'QueryFinish'") == "1\n" E AssertionError: assert '0\n' == '1\n' E - 1 E + 0 test_storage_iceberg/test.py:861: AssertionError ----------------------------- Captured stdout call ----------------------------- 25/05/23 21:10:53 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:53 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:53 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:53 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:53 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:53 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. {} {} {} Upload to bucket: None {} Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None ------------------------------ Captured log call ------------------------------- 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro686 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o686 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o61 range i0 i100 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro687 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ylo688 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o688 add sa e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro688 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro689 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o687 toDF ro689 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro690 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro691 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o691 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o61 range i1 i101 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro692 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ylo693 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o693 add sb e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro693 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro694 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o692 toDF ro694 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro695 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o695 apply sb e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro696 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro697 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o697 isDefined e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro698 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o698 get e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro699 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro700 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yao701 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o700 applyModifiableSettings ro699 ro701 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o61 parseDataType s"string" e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro702 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o696 cast ro702 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro703 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o695 withColumn sb ro703 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro704 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro705 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro706 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ylo707 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o707 add ro706 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro707 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro708 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro708 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro709 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o705 over ro709 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro710 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o690 withColumn srow_index ro710 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro711 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro712 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro713 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ylo714 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o714 add ro713 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro714 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro715 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro715 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro716 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o712 over ro716 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro717 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o704 withColumn srow_index ro717 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro718 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ylo719 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o719 add srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro719 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro720 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o711 join ro718 ro720 sinner e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro721 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o721 drop srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro722 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o722 writeTo stest_delete_files_1_s3_0f7643e7_51ce_4a74_9d9b_7adb85b77574 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro723 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o723 tableProperty sformat-version s1 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro724 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o723 using siceberg e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro725 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o723 create e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_delete_files_1_s3_0f7643e7_51ce_4a74_9d9b_7adb85b77574/data/00000-33-7711b9ce-a1df-4d96-931a-93fa42702636-00001.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:53 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_delete_files_1_s3_0f7643e7_51ce_4a74_9d9b_7adb85b77574/metadata/snap-2000577770602782118-1-b0cd795d-6d55-4f01-a2cb-d0a37eff0783.avro HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:53 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_delete_files_1_s3_0f7643e7_51ce_4a74_9d9b_7adb85b77574/metadata/b0cd795d-6d55-4f01-a2cb-d0a37eff0783-m0.avro HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:53 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_delete_files_1_s3_0f7643e7_51ce_4a74_9d9b_7adb85b77574/metadata/version-hint.text HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:53 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_delete_files_1_s3_0f7643e7_51ce_4a74_9d9b_7adb85b77574/metadata/v1.metadata.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:53 [ 671 ] DEBUG : Executing query DROP TABLE IF EXISTS test_delete_files_1_s3_0f7643e7_51ce_4a74_9d9b_7adb85b77574 SYNC on node1 (cluster.py:3570, query) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: m d o683 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: m d o682 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: m d o688 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: m d o693 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: m d o701 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: m d o707 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: m d o714 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: m d o719 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: m d o686 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: m d o687 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: m d o689 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: m d o690 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: m d o691 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: m d o692 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: m d o694 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: m d o695 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: m d o696 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: m d o697 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: m d o698 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: m d o700 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: m d o702 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: m d o703 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: m d o704 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: m d o705 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: m d o706 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: m d o708 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: m d o709 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: m d o710 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: m d o711 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: m d o712 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: m d o713 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: m d o715 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: m d o716 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: m d o717 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: m d o718 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: m d o720 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: m d o721 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: m d o724 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: m d o725 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Executing query DROP TABLE IF EXISTS test_delete_files_1_s3_0f7643e7_51ce_4a74_9d9b_7adb85b77574; CREATE TABLE test_delete_files_1_s3_0f7643e7_51ce_4a74_9d9b_7adb85b77574 ENGINE=IcebergS3(s3, filename = 'iceberg_data/default/test_delete_files_1_s3_0f7643e7_51ce_4a74_9d9b_7adb85b77574/', format=Parquet, url = 'http://minio1:9001/root/') on node1 (cluster.py:3570, query) 2025-05-23 21:10:53 [ 671 ] DEBUG : Executing query SELECT count() FROM test_delete_files_1_s3_0f7643e7_51ce_4a74_9d9b_7adb85b77574 on node1 (cluster.py:3570, query) 2025-05-23 21:10:53 [ 671 ] DEBUG : Executing query SYSTEM FLUSH LOGS on node1 (cluster.py:3570, query) 2025-05-23 21:10:53 [ 671 ] DEBUG : Executing query SELECT ProfileEvents['IcebergTrivialCountOptimizationApplied'] FROM system.query_log where query_id = 'test_trivial_count_27d3601a_35d0_4c8d_aa87_ec6d673c465a' and type = 'QueryFinish' on node1 (cluster.py:3570, query) ___________________________ test_delete_files[s3-2] ____________________________ [gw1] linux -- Python 3.10.12 /usr/bin/python3 started_cluster = format_version = '2', storage_type = 's3' @pytest.mark.parametrize("format_version", ["1", "2"]) @pytest.mark.parametrize("storage_type", ["s3", "azure", "local"]) def test_delete_files(started_cluster, format_version, storage_type): instance = started_cluster.instances["node1"] spark = started_cluster.spark_session TABLE_NAME = ( "test_delete_files_" + format_version + "_" + storage_type + "_" + get_uuid_str() ) write_iceberg_from_df( spark, generate_data(spark, 0, 100), TABLE_NAME, mode="overwrite", format_version=format_version, ) default_upload_directory( started_cluster, storage_type, f"/iceberg_data/default/{TABLE_NAME}/", f"/iceberg_data/default/{TABLE_NAME}/", ) create_iceberg_table(storage_type, instance, TABLE_NAME, started_cluster) # Test trivial count with deleted files query_id = "test_trivial_count_" + get_uuid_str() assert int(instance.query(f"SELECT count() FROM {TABLE_NAME}", query_id=query_id)) == 100 instance.query("SYSTEM FLUSH LOGS") > assert instance.query(f"SELECT ProfileEvents['IcebergTrivialCountOptimizationApplied'] FROM system.query_log where query_id = '{query_id}' and type = 'QueryFinish'") == "1\n" E AssertionError: assert '0\n' == '1\n' E - 1 E + 0 test_storage_iceberg/test.py:861: AssertionError ----------------------------- Captured stdout call ----------------------------- 25/05/23 21:10:54 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:54 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:54 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:54 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:54 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:54 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. {} {} {} Upload to bucket: None {} Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None ------------------------------ Captured log call ------------------------------- 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro726 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o726 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o61 range i0 i100 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro727 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ylo728 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o728 add sa e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro728 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro729 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o727 toDF ro729 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro730 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro731 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o731 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o61 range i1 i101 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro732 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ylo733 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o733 add sb e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro733 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro734 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o732 toDF ro734 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro735 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o735 apply sb e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro736 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro737 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o737 isDefined e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro738 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o738 get e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro739 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro740 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yao741 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o740 applyModifiableSettings ro739 ro741 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o61 parseDataType s"string" e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro742 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o736 cast ro742 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro743 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o735 withColumn sb ro743 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro744 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro745 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro746 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ylo747 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o747 add ro746 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro747 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro748 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro748 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro749 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o745 over ro749 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro750 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o730 withColumn srow_index ro750 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro751 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro752 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro753 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ylo754 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o754 add ro753 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro754 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro755 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro755 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro756 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o752 over ro756 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro757 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o744 withColumn srow_index ro757 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro758 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ylo759 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o759 add srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro759 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro760 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o751 join ro758 ro760 sinner e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro761 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o761 drop srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro762 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o762 writeTo stest_delete_files_2_s3_1bd3f2ff_26f4_4055_9802_404b0796acc1 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro763 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o763 tableProperty sformat-version s2 e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro764 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o763 using siceberg e (clientserver.py:501, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Answer received: !yro765 (clientserver.py:512, send_command) 2025-05-23 21:10:53 [ 671 ] DEBUG : Command to send: c o763 create e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_delete_files_2_s3_1bd3f2ff_26f4_4055_9802_404b0796acc1/data/00000-35-cc9ccc27-c457-4164-8352-2b278813eb71-00001.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:54 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_delete_files_2_s3_1bd3f2ff_26f4_4055_9802_404b0796acc1/metadata/snap-8855749196059159268-1-36bfe51b-f420-471c-90e2-a7fe4fb86bac.avro HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:54 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_delete_files_2_s3_1bd3f2ff_26f4_4055_9802_404b0796acc1/metadata/version-hint.text HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:54 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_delete_files_2_s3_1bd3f2ff_26f4_4055_9802_404b0796acc1/metadata/36bfe51b-f420-471c-90e2-a7fe4fb86bac-m0.avro HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:54 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_delete_files_2_s3_1bd3f2ff_26f4_4055_9802_404b0796acc1/metadata/v1.metadata.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:54 [ 671 ] DEBUG : Executing query DROP TABLE IF EXISTS test_delete_files_2_s3_1bd3f2ff_26f4_4055_9802_404b0796acc1 SYNC on node1 (cluster.py:3570, query) 2025-05-23 21:10:54 [ 671 ] DEBUG : Executing query DROP TABLE IF EXISTS test_delete_files_2_s3_1bd3f2ff_26f4_4055_9802_404b0796acc1; CREATE TABLE test_delete_files_2_s3_1bd3f2ff_26f4_4055_9802_404b0796acc1 ENGINE=IcebergS3(s3, filename = 'iceberg_data/default/test_delete_files_2_s3_1bd3f2ff_26f4_4055_9802_404b0796acc1/', format=Parquet, url = 'http://minio1:9001/root/') on node1 (cluster.py:3570, query) 2025-05-23 21:10:54 [ 671 ] DEBUG : Executing query SELECT count() FROM test_delete_files_2_s3_1bd3f2ff_26f4_4055_9802_404b0796acc1 on node1 (cluster.py:3570, query) 2025-05-23 21:10:54 [ 671 ] DEBUG : Executing query SYSTEM FLUSH LOGS on node1 (cluster.py:3570, query) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: m d o723 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: m d o722 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: m d o728 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: m d o733 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: m d o741 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: m d o747 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: m d o754 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: m d o759 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: m d o726 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: m d o727 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: m d o729 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: m d o730 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: m d o731 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: m d o732 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: m d o734 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: m d o735 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: m d o736 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: m d o737 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: m d o738 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: m d o740 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: m d o742 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: m d o743 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: m d o744 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: m d o745 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: m d o746 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: m d o748 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: m d o749 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: m d o750 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: m d o751 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: m d o752 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: m d o753 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: m d o755 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: m d o756 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: m d o757 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: m d o758 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: m d o760 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: m d o761 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: m d o764 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: m d o765 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Executing query SELECT ProfileEvents['IcebergTrivialCountOptimizationApplied'] FROM system.query_log where query_id = 'test_trivial_count_ba87006f_69fa_428b_84b5_f19a0f9dd430' and type = 'QueryFinish' on node1 (cluster.py:3570, query) _____________________ test_iceberg_snapshot_reads[azure-1] _____________________ [gw1] linux -- Python 3.10.12 /usr/bin/python3 started_cluster = format_version = '1', storage_type = 'azure' @pytest.mark.parametrize("format_version", ["1", "2"]) @pytest.mark.parametrize("storage_type", ["s3", "azure", "local"]) def test_iceberg_snapshot_reads(started_cluster, format_version, storage_type): instance = started_cluster.instances["node1"] spark = started_cluster.spark_session TABLE_NAME = ( "test_iceberg_snapshot_reads" + format_version + "_" + storage_type + "_" + get_uuid_str() ) write_iceberg_from_df( spark, generate_data(spark, 0, 100), TABLE_NAME, mode="overwrite", format_version=format_version, ) default_upload_directory( started_cluster, storage_type, f"/iceberg_data/default/{TABLE_NAME}/", "", ) create_iceberg_table(storage_type, instance, TABLE_NAME, started_cluster) assert int(instance.query(f"SELECT count() FROM {TABLE_NAME}")) == 100 snapshot1_timestamp = datetime.now(timezone.utc) snapshot1_id = get_last_snapshot(f"/iceberg_data/default/{TABLE_NAME}/") > time.sleep(0.1) E NameError: name 'time' is not defined test_storage_iceberg/test.py:2568: NameError ----------------------------- Captured stdout call ----------------------------- 25/05/23 21:10:54 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:54 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:54 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:54 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:54 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:54 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. {} {} {} {'format-version': 1, 'table-uuid': '755e4a0a-af17-4485-aa1e-11d1dfb2692a', 'location': '/iceberg_data/default/test_iceberg_snapshot_reads1_azure_c0e822cd_37dc_4c0e_a3cd_fbb6e9c1b776', 'last-updated-ms': 1748034654900, 'last-column-id': 2, 'schema': {'type': 'struct', 'schema-id': 0, 'fields': [{'id': 1, 'name': 'a', 'required': False, 'type': 'long'}, {'id': 2, 'name': 'b', 'required': False, 'type': 'string'}]}, 'current-schema-id': 0, 'schemas': [{'type': 'struct', 'schema-id': 0, 'fields': [{'id': 1, 'name': 'a', 'required': False, 'type': 'long'}, {'id': 2, 'name': 'b', 'required': False, 'type': 'string'}]}], 'partition-spec': [], 'default-spec-id': 0, 'partition-specs': [{'spec-id': 0, 'fields': []}], 'last-partition-id': 999, 'default-sort-order-id': 0, 'sort-orders': [{'order-id': 0, 'fields': []}], 'properties': {'owner': 'root'}, 'current-snapshot-id': 886743269630435187, 'refs': {'main': {'snapshot-id': 886743269630435187, 'type': 'branch'}}, 'snapshots': [{'snapshot-id': 886743269630435187, 'timestamp-ms': 1748034654900, 'summary': {'operation': 'append', 'spark.app.id': 'local-1748034636432', 'added-data-files': '1', 'added-records': '100', 'added-files-size': '967', 'changed-partition-count': '1', 'total-records': '100', 'total-files-size': '967', 'total-data-files': '1', 'total-delete-files': '0', 'total-position-deletes': '0', 'total-equality-deletes': '0'}, 'manifest-list': '/iceberg_data/default/test_iceberg_snapshot_reads1_azure_c0e822cd_37dc_4c0e_a3cd_fbb6e9c1b776/metadata/snap-886743269630435187-1-c59d58af-244a-480d-98fe-d78f8ce4cd76.avro', 'schema-id': 0}], 'statistics': [], 'snapshot-log': [{'timestamp-ms': 1748034654900, 'snapshot-id': 886743269630435187}], 'metadata-log': []} ------------------------------ Captured log call ------------------------------- 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yro766 (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: c o766 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: c o61 range i0 i100 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yro767 (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !ylo768 (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: c o768 add sa e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro768 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yro769 (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: c o767 toDF ro769 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yro770 (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yro771 (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: c o771 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: c o61 range i1 i101 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yro772 (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !ylo773 (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: c o773 add sb e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro773 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yro774 (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: c o772 toDF ro774 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yro775 (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: c o775 apply sb e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yro776 (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yro777 (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: c o777 isDefined e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yro778 (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: c o778 get e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yro779 (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yro780 (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yao781 (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: c o780 applyModifiableSettings ro779 ro781 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: c o61 parseDataType s"string" e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yro782 (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: c o776 cast ro782 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yro783 (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: c o775 withColumn sb ro783 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yro784 (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yro785 (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yro786 (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !ylo787 (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: c o787 add ro786 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro787 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yro788 (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro788 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yro789 (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: c o785 over ro789 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yro790 (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: c o770 withColumn srow_index ro790 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yro791 (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yro792 (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yro793 (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !ylo794 (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: c o794 add ro793 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro794 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yro795 (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro795 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yro796 (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: c o792 over ro796 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yro797 (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: c o784 withColumn srow_index ro797 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yro798 (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !ylo799 (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: c o799 add srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro799 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yro800 (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: c o791 join ro798 ro800 sinner e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yro801 (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: c o801 drop srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yro802 (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: c o802 writeTo stest_iceberg_snapshot_reads1_azure_c0e822cd_37dc_4c0e_a3cd_fbb6e9c1b776 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yro803 (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: c o803 tableProperty sformat-version s1 e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yro804 (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: c o803 using siceberg e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yro805 (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Command to send: c o803 create e (clientserver.py:501, send_command) 2025-05-23 21:10:54 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:54 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_snapshot_reads1_azure_c0e822cd_37dc_4c0e_a3cd_fbb6e9c1b776/data/00000-37-66205202-4ed3-4a81-83d9-58215a9491b3-00001.parquet' Request method: 'PUT' Request headers: 'Content-Length': '967' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '6a1e7798-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:54 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_snapshot_reads1_azure_c0e822cd_37dc_4c0e_a3cd_fbb6e9c1b776/data/00000-37-66205202-4ed3-4a81-83d9-58215a9491b3-00001.parquet HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:54 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x2389B15DCA28E20"' 'last-modified': 'Fri, 23 May 2025 21:10:54 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '6a1e7798-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': 'f252706e-29bc-49fc-86f8-6f695ddf0293' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:54 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:54 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_snapshot_reads1_azure_c0e822cd_37dc_4c0e_a3cd_fbb6e9c1b776/metadata/snap-886743269630435187-1-c59d58af-244a-480d-98fe-d78f8ce4cd76.avro' Request method: 'PUT' Request headers: 'Content-Length': '3799' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '6a202c3c-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:54 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_snapshot_reads1_azure_c0e822cd_37dc_4c0e_a3cd_fbb6e9c1b776/metadata/snap-886743269630435187-1-c59d58af-244a-480d-98fe-d78f8ce4cd76.avro HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:54 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x23C5B57776E5880"' 'last-modified': 'Fri, 23 May 2025 21:10:54 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '6a202c3c-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '44a96ef2-1004-4543-866f-fb7f12e1be2e' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:54 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:54 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_snapshot_reads1_azure_c0e822cd_37dc_4c0e_a3cd_fbb6e9c1b776/metadata/c59d58af-244a-480d-98fe-d78f8ce4cd76-m0.avro' Request method: 'PUT' Request headers: 'Content-Length': '5828' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '6a21a936-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:54 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_snapshot_reads1_azure_c0e822cd_37dc_4c0e_a3cd_fbb6e9c1b776/metadata/c59d58af-244a-480d-98fe-d78f8ce4cd76-m0.avro HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:54 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x1F04CB70A509600"' 'last-modified': 'Fri, 23 May 2025 21:10:54 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '6a21a936-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '25b8aa53-6ae8-4615-b426-fbd72b3456f5' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:54 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:54 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_snapshot_reads1_azure_c0e822cd_37dc_4c0e_a3cd_fbb6e9c1b776/metadata/version-hint.text' Request method: 'PUT' Request headers: 'Content-Length': '1' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '6a230b00-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:54 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_snapshot_reads1_azure_c0e822cd_37dc_4c0e_a3cd_fbb6e9c1b776/metadata/version-hint.text HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:54 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x1C7EED4D20A98E0"' 'last-modified': 'Fri, 23 May 2025 21:10:54 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '6a230b00-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': 'f8f40caf-277e-4b0b-bd20-94d953986b95' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:54 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:54 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_snapshot_reads1_azure_c0e822cd_37dc_4c0e_a3cd_fbb6e9c1b776/metadata/v1.metadata.json' Request method: 'PUT' Request headers: 'Content-Length': '2187' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '6a244ba0-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:54 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_snapshot_reads1_azure_c0e822cd_37dc_4c0e_a3cd_fbb6e9c1b776/metadata/v1.metadata.json HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:54 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x2552458A35E0520"' 'last-modified': 'Fri, 23 May 2025 21:10:54 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '6a244ba0-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': 'ea3c77f2-e298-44ab-b3a4-c357353e3497' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:54 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:54 [ 671 ] DEBUG : Executing query DROP TABLE IF EXISTS test_iceberg_snapshot_reads1_azure_c0e822cd_37dc_4c0e_a3cd_fbb6e9c1b776 SYNC on node1 (cluster.py:3570, query) 2025-05-23 21:10:55 [ 671 ] DEBUG : Executing query DROP TABLE IF EXISTS test_iceberg_snapshot_reads1_azure_c0e822cd_37dc_4c0e_a3cd_fbb6e9c1b776; CREATE TABLE test_iceberg_snapshot_reads1_azure_c0e822cd_37dc_4c0e_a3cd_fbb6e9c1b776 ENGINE=IcebergAzure(azure, container = mycontainer, storage_account_url = 'http://azurite1:30050/devstoreaccount1', blob_path = '/iceberg_data/default/test_iceberg_snapshot_reads1_azure_c0e822cd_37dc_4c0e_a3cd_fbb6e9c1b776/', format=Parquet) on node1 (cluster.py:3570, query) 2025-05-23 21:10:55 [ 671 ] DEBUG : Executing query SELECT count() FROM test_iceberg_snapshot_reads1_azure_c0e822cd_37dc_4c0e_a3cd_fbb6e9c1b776 on node1 (cluster.py:3570, query) _____________________ test_iceberg_snapshot_reads[azure-2] _____________________ [gw1] linux -- Python 3.10.12 /usr/bin/python3 started_cluster = format_version = '2', storage_type = 'azure' @pytest.mark.parametrize("format_version", ["1", "2"]) @pytest.mark.parametrize("storage_type", ["s3", "azure", "local"]) def test_iceberg_snapshot_reads(started_cluster, format_version, storage_type): instance = started_cluster.instances["node1"] spark = started_cluster.spark_session TABLE_NAME = ( "test_iceberg_snapshot_reads" + format_version + "_" + storage_type + "_" + get_uuid_str() ) write_iceberg_from_df( spark, generate_data(spark, 0, 100), TABLE_NAME, mode="overwrite", format_version=format_version, ) default_upload_directory( started_cluster, storage_type, f"/iceberg_data/default/{TABLE_NAME}/", "", ) create_iceberg_table(storage_type, instance, TABLE_NAME, started_cluster) assert int(instance.query(f"SELECT count() FROM {TABLE_NAME}")) == 100 snapshot1_timestamp = datetime.now(timezone.utc) snapshot1_id = get_last_snapshot(f"/iceberg_data/default/{TABLE_NAME}/") > time.sleep(0.1) E NameError: name 'time' is not defined test_storage_iceberg/test.py:2568: NameError ----------------------------- Captured stdout call ----------------------------- 25/05/23 21:10:55 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:55 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:55 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:55 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:55 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:55 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. {} {} {} {'format-version': 2, 'table-uuid': '925f9423-3298-420d-ba83-c88dd36d2460', 'location': '/iceberg_data/default/test_iceberg_snapshot_reads2_azure_291c7853_5ad9_45dc_85ed_68ec31d334f8', 'last-sequence-number': 1, 'last-updated-ms': 1748034655635, 'last-column-id': 2, 'current-schema-id': 0, 'schemas': [{'type': 'struct', 'schema-id': 0, 'fields': [{'id': 1, 'name': 'a', 'required': False, 'type': 'long'}, {'id': 2, 'name': 'b', 'required': False, 'type': 'string'}]}], 'default-spec-id': 0, 'partition-specs': [{'spec-id': 0, 'fields': []}], 'last-partition-id': 999, 'default-sort-order-id': 0, 'sort-orders': [{'order-id': 0, 'fields': []}], 'properties': {'owner': 'root'}, 'current-snapshot-id': 3388539846378411572, 'refs': {'main': {'snapshot-id': 3388539846378411572, 'type': 'branch'}}, 'snapshots': [{'sequence-number': 1, 'snapshot-id': 3388539846378411572, 'timestamp-ms': 1748034655635, 'summary': {'operation': 'append', 'spark.app.id': 'local-1748034636432', 'added-data-files': '1', 'added-records': '100', 'added-files-size': '967', 'changed-partition-count': '1', 'total-records': '100', 'total-files-size': '967', 'total-data-files': '1', 'total-delete-files': '0', 'total-position-deletes': '0', 'total-equality-deletes': '0'}, 'manifest-list': '/iceberg_data/default/test_iceberg_snapshot_reads2_azure_291c7853_5ad9_45dc_85ed_68ec31d334f8/metadata/snap-3388539846378411572-1-c06a650b-dc30-4c52-844c-8bf157c62381.avro', 'schema-id': 0}], 'statistics': [], 'snapshot-log': [{'timestamp-ms': 1748034655635, 'snapshot-id': 3388539846378411572}], 'metadata-log': []} ------------------------------ Captured log call ------------------------------- 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro806 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o806 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o61 range i0 i100 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro807 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ylo808 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o808 add sa e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro808 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro809 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o807 toDF ro809 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro810 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro811 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o811 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o61 range i1 i101 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro812 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ylo813 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o813 add sb e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro813 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro814 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o812 toDF ro814 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro815 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o815 apply sb e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro816 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro817 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o817 isDefined e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro818 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o818 get e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro819 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro820 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yao821 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o820 applyModifiableSettings ro819 ro821 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o61 parseDataType s"string" e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro822 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o816 cast ro822 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro823 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o815 withColumn sb ro823 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro824 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro825 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro826 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ylo827 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o827 add ro826 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro827 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro828 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro828 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro829 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o825 over ro829 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro830 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o810 withColumn srow_index ro830 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro831 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro832 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro833 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ylo834 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o834 add ro833 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro834 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro835 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro835 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro836 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o832 over ro836 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro837 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o824 withColumn srow_index ro837 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro838 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ylo839 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o839 add srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro839 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro840 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o831 join ro838 ro840 sinner e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro841 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o841 drop srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro842 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o842 writeTo stest_iceberg_snapshot_reads2_azure_291c7853_5ad9_45dc_85ed_68ec31d334f8 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro843 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o843 tableProperty sformat-version s2 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro844 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o843 using siceberg e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro845 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o843 create e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o763 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o762 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o768 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o773 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o781 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o787 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o794 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o799 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o766 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o767 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o769 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o770 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o771 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o772 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o774 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o775 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o776 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o777 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o778 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o780 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o782 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o783 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o784 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o785 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o786 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o788 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o789 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o790 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o791 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o792 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o793 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o795 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o796 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o797 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o798 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o800 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o801 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o804 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o805 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o803 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o802 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o579 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o619 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o659 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o699 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o739 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o808 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o813 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o821 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o827 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o834 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o839 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o806 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o807 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o809 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o810 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o811 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o812 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o814 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o815 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o816 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o817 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o818 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o820 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o822 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o823 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o824 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o825 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o826 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o828 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o829 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o830 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o832 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o833 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o835 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o836 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o837 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o844 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: m d o845 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_snapshot_reads2_azure_291c7853_5ad9_45dc_85ed_68ec31d334f8/data/00000-39-b966d7e0-6186-494f-aa21-58e7e3ec38f0-00001.parquet' Request method: 'PUT' Request headers: 'Content-Length': '967' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '6a8e5a54-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:55 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_snapshot_reads2_azure_291c7853_5ad9_45dc_85ed_68ec31d334f8/data/00000-39-b966d7e0-6186-494f-aa21-58e7e3ec38f0-00001.parquet HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:55 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x1DDBCB7E86C18E0"' 'last-modified': 'Fri, 23 May 2025 21:10:55 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '6a8e5a54-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '350aae92-e4ca-48db-8366-162a8bd251ba' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:55 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:55 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_snapshot_reads2_azure_291c7853_5ad9_45dc_85ed_68ec31d334f8/metadata/version-hint.text' Request method: 'PUT' Request headers: 'Content-Length': '1' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '6a8f81d6-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:55 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_snapshot_reads2_azure_291c7853_5ad9_45dc_85ed_68ec31d334f8/metadata/version-hint.text HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:55 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x2092407308FF900"' 'last-modified': 'Fri, 23 May 2025 21:10:55 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '6a8f81d6-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '6b0a0f7c-369d-4e88-b182-ec8f46a4d9c4' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:55 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:55 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_snapshot_reads2_azure_291c7853_5ad9_45dc_85ed_68ec31d334f8/metadata/snap-3388539846378411572-1-c06a650b-dc30-4c52-844c-8bf157c62381.avro' Request method: 'PUT' Request headers: 'Content-Length': '4300' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '6a90714a-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:55 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_snapshot_reads2_azure_291c7853_5ad9_45dc_85ed_68ec31d334f8/metadata/snap-3388539846378411572-1-c06a650b-dc30-4c52-844c-8bf157c62381.avro HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:55 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x1C20D4396A98DA0"' 'last-modified': 'Fri, 23 May 2025 21:10:55 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '6a90714a-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '3361f5ca-1b1e-4b2e-b60d-e8992e1e963a' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:55 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:55 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_snapshot_reads2_azure_291c7853_5ad9_45dc_85ed_68ec31d334f8/metadata/v1.metadata.json' Request method: 'PUT' Request headers: 'Content-Length': '1953' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '6a918170-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:55 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_snapshot_reads2_azure_291c7853_5ad9_45dc_85ed_68ec31d334f8/metadata/v1.metadata.json HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:55 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x1E8FF13B7C969F0"' 'last-modified': 'Fri, 23 May 2025 21:10:55 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '6a918170-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '8137b158-3fb6-4354-826d-c534f77adfd1' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:55 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:55 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_snapshot_reads2_azure_291c7853_5ad9_45dc_85ed_68ec31d334f8/metadata/c06a650b-dc30-4c52-844c-8bf157c62381-m0.avro' Request method: 'PUT' Request headers: 'Content-Length': '6716' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '6a92bdce-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:55 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_iceberg_snapshot_reads2_azure_291c7853_5ad9_45dc_85ed_68ec31d334f8/metadata/c06a650b-dc30-4c52-844c-8bf157c62381-m0.avro HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:55 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x2371F1DD3716B80"' 'last-modified': 'Fri, 23 May 2025 21:10:55 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '6a92bdce-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '2f714b71-d08c-487f-be99-e8e1130c2682' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:55 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:55 [ 671 ] DEBUG : Executing query DROP TABLE IF EXISTS test_iceberg_snapshot_reads2_azure_291c7853_5ad9_45dc_85ed_68ec31d334f8 SYNC on node1 (cluster.py:3570, query) 2025-05-23 21:10:55 [ 671 ] DEBUG : Executing query DROP TABLE IF EXISTS test_iceberg_snapshot_reads2_azure_291c7853_5ad9_45dc_85ed_68ec31d334f8; CREATE TABLE test_iceberg_snapshot_reads2_azure_291c7853_5ad9_45dc_85ed_68ec31d334f8 ENGINE=IcebergAzure(azure, container = mycontainer, storage_account_url = 'http://azurite1:30050/devstoreaccount1', blob_path = '/iceberg_data/default/test_iceberg_snapshot_reads2_azure_291c7853_5ad9_45dc_85ed_68ec31d334f8/', format=Parquet) on node1 (cluster.py:3570, query) 2025-05-23 21:10:55 [ 671 ] DEBUG : Executing query SELECT count() FROM test_iceberg_snapshot_reads2_azure_291c7853_5ad9_45dc_85ed_68ec31d334f8 on node1 (cluster.py:3570, query) _____________________ test_iceberg_snapshot_reads[local-1] _____________________ [gw1] linux -- Python 3.10.12 /usr/bin/python3 started_cluster = format_version = '1', storage_type = 'local' @pytest.mark.parametrize("format_version", ["1", "2"]) @pytest.mark.parametrize("storage_type", ["s3", "azure", "local"]) def test_iceberg_snapshot_reads(started_cluster, format_version, storage_type): instance = started_cluster.instances["node1"] spark = started_cluster.spark_session TABLE_NAME = ( "test_iceberg_snapshot_reads" + format_version + "_" + storage_type + "_" + get_uuid_str() ) write_iceberg_from_df( spark, generate_data(spark, 0, 100), TABLE_NAME, mode="overwrite", format_version=format_version, ) default_upload_directory( started_cluster, storage_type, f"/iceberg_data/default/{TABLE_NAME}/", "", ) create_iceberg_table(storage_type, instance, TABLE_NAME, started_cluster) assert int(instance.query(f"SELECT count() FROM {TABLE_NAME}")) == 100 snapshot1_timestamp = datetime.now(timezone.utc) snapshot1_id = get_last_snapshot(f"/iceberg_data/default/{TABLE_NAME}/") > time.sleep(0.1) E NameError: name 'time' is not defined test_storage_iceberg/test.py:2568: NameError ----------------------------- Captured stdout call ----------------------------- 25/05/23 21:10:56 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:56 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:56 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:56 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:56 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:56 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. {} {} {} {'format-version': 1, 'table-uuid': '5c64d591-356b-4ff4-9081-0debf4f98c40', 'location': '/iceberg_data/default/test_iceberg_snapshot_reads1_local_9ef16ce6_8487_4d44_aab2_bcabf0c395aa', 'last-updated-ms': 1748034656127, 'last-column-id': 2, 'schema': {'type': 'struct', 'schema-id': 0, 'fields': [{'id': 1, 'name': 'a', 'required': False, 'type': 'long'}, {'id': 2, 'name': 'b', 'required': False, 'type': 'string'}]}, 'current-schema-id': 0, 'schemas': [{'type': 'struct', 'schema-id': 0, 'fields': [{'id': 1, 'name': 'a', 'required': False, 'type': 'long'}, {'id': 2, 'name': 'b', 'required': False, 'type': 'string'}]}], 'partition-spec': [], 'default-spec-id': 0, 'partition-specs': [{'spec-id': 0, 'fields': []}], 'last-partition-id': 999, 'default-sort-order-id': 0, 'sort-orders': [{'order-id': 0, 'fields': []}], 'properties': {'owner': 'root'}, 'current-snapshot-id': 5830780686733483174, 'refs': {'main': {'snapshot-id': 5830780686733483174, 'type': 'branch'}}, 'snapshots': [{'snapshot-id': 5830780686733483174, 'timestamp-ms': 1748034656127, 'summary': {'operation': 'append', 'spark.app.id': 'local-1748034636432', 'added-data-files': '1', 'added-records': '100', 'added-files-size': '967', 'changed-partition-count': '1', 'total-records': '100', 'total-files-size': '967', 'total-data-files': '1', 'total-delete-files': '0', 'total-position-deletes': '0', 'total-equality-deletes': '0'}, 'manifest-list': '/iceberg_data/default/test_iceberg_snapshot_reads1_local_9ef16ce6_8487_4d44_aab2_bcabf0c395aa/metadata/snap-5830780686733483174-1-6db91d2a-4809-4c7e-b076-8841e7e9fdd8.avro', 'schema-id': 0}], 'statistics': [], 'snapshot-log': [{'timestamp-ms': 1748034656127, 'snapshot-id': 5830780686733483174}], 'metadata-log': []} ------------------------------ Captured log call ------------------------------- 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro846 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o846 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o61 range i0 i100 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro847 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ylo848 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o848 add sa e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro848 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro849 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o847 toDF ro849 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro850 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro851 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o851 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o61 range i1 i101 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro852 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ylo853 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o853 add sb e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro853 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro854 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o852 toDF ro854 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro855 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o855 apply sb e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro856 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro857 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o857 isDefined e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro858 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o858 get e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro859 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro860 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yao861 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o860 applyModifiableSettings ro859 ro861 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o61 parseDataType s"string" e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro862 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o856 cast ro862 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro863 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o855 withColumn sb ro863 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro864 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro865 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro866 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ylo867 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o867 add ro866 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro867 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro868 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro868 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro869 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o865 over ro869 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro870 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o850 withColumn srow_index ro870 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro871 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro872 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro873 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ylo874 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o874 add ro873 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro874 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro875 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro875 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro876 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o872 over ro876 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro877 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o864 withColumn srow_index ro877 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro878 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ylo879 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o879 add srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro879 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro880 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o871 join ro878 ro880 sinner e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro881 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o881 drop srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro882 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o882 writeTo stest_iceberg_snapshot_reads1_local_9ef16ce6_8487_4d44_aab2_bcabf0c395aa e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro883 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o883 tableProperty sformat-version s1 e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro884 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o883 using siceberg e (clientserver.py:501, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Answer received: !yro885 (clientserver.py:512, send_command) 2025-05-23 21:10:55 [ 671 ] DEBUG : Command to send: c o883 create e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : run container_id:rootteststorageiceberg-gw1-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p /iceberg_data/default/test_iceberg_snapshot_reads1_local_9ef16ce6_8487_4d44_aab2_bcabf0c395aa/data'] (cluster.py:2045, exec_in_container) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command:[docker exec rootteststorageiceberg-gw1-node1-1 bash -c mkdir -p /iceberg_data/default/test_iceberg_snapshot_reads1_local_9ef16ce6_8487_4d44_aab2_bcabf0c395aa/data] (cluster.py:121, run_and_check) 2025-05-23 21:10:56 [ 671 ] DEBUG : run container_id:rootteststorageiceberg-gw1-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname /iceberg_data/default/test_iceberg_snapshot_reads1_local_9ef16ce6_8487_4d44_aab2_bcabf0c395aa/data/00000-41-f99abe1d-fdc8-408d-a636-ec9a6ed71ab9-00001.parquet) && echo UEFSMRUAFcAMFfYCFb3z1JUGHBXIARUAFQgVCAAAH4sIAAAAAAAAAC3F1yICAAAAwJBZIVskK7OyM0OK7IzKjvL//+DB3csFAv9a3Oo2B93uDne6y93ucchhR9zrPvc76gEPesjDHvGoxzzumCc86binnPC0ZzzrOc876QUvesnLXvGqU0474zWve8Ob3vK2d5z1rve87wMf+sg5H/vEp877zAUXfe4Ll3zpK1/7xre+873LfvCjn/zsiquu+cWvfvO7P/zpL9f97R833PSv/wACwudxIAMAABUAFaAJFeoCFY28v7gJHBXIARUAFQgVCAAAH4sIAAAAAAAAAB3SsYFCMQxEwQ/XEFiyJPffGOdJXrST7et5nu/rP+smbvJm39RN38zNed/xR7+6NDR1a2nrKLvYxS52sYtd7GIXu9jFBhtssMEGG2ywwQYbbLLJJptssskmm2yyyW52s5vd7GY3u9nNbnazxRZbbLHFFltsscUW22yzzTbbbLPNNttss8MOO+ywww477LDDDnvYwx72sIc97GEPe9hz/nzj8wPU24atUAIAABkRAhkYCAAAAAAAAAAAGRgIYwAAAAAAAAAVAhkWAAAZEQIZGAExGRgCOTkVAhkWAAAZHBYIFaoDFgAAABkcFrIDFZ4DFgAAABUCGTxIBXRhYmxlFQQAFQQlABgBYVUCABUMJQAYAWIlADUEHBwAAAAWyAEZHBksJggcFQQZJQAIGRgBYRUEFsgBFvQMFqoDJgg8GAhjAAAAAAAAABgIAAAAAAAAAAAWACgIYwAAAAAAAAAYCAAAAAAAAAAAABkcFQAVABUCAAAWsgcVFhbQBhU+ACayAxwVDBklAAgZGAFiFQQWyAEW1AkWngMmsgM8NgAoAjk5GAExABkcFQAVABUCAAAWyAcVGBaOBxUkABbIFhbIASYIFsgGFAAAGRwYDmljZWJlcmcuc2NoZW1hGJABeyJ0eXBlIjoic3RydWN0Iiwic2NoZW1hLWlkIjowLCJmaWVsZHMiOlt7ImlkIjoxLCJuYW1lIjoiYSIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjoibG9uZyJ9LHsiaWQiOjIsIm5hbWUiOiJiIiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJzdHJpbmcifV19ABhKcGFycXVldC1tciB2ZXJzaW9uIDEuMTIuMyAoYnVpbGQgZjhkY2VkMTgyYzRjMWZiZGVjNmNjYjMxODU1MzdiNWEwMWU2ZWQ2YikZLBwAABwAAADPAQAAUEFSMQ== | base64 --decode > /iceberg_data/default/test_iceberg_snapshot_reads1_local_9ef16ce6_8487_4d44_aab2_bcabf0c395aa/data/00000-41-f99abe1d-fdc8-408d-a636-ec9a6ed71ab9-00001.parquet'] (cluster.py:2045, exec_in_container) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command:[docker exec rootteststorageiceberg-gw1-node1-1 bash -c mkdir -p $(dirname /iceberg_data/default/test_iceberg_snapshot_reads1_local_9ef16ce6_8487_4d44_aab2_bcabf0c395aa/data/00000-41-f99abe1d-fdc8-408d-a636-ec9a6ed71ab9-00001.parquet) && echo UEFSMRUAFcAMFfYCFb3z1JUGHBXIARUAFQgVCAAAH4sIAAAAAAAAAC3F1yICAAAAwJBZIVskK7OyM0OK7IzKjvL//+DB3csFAv9a3Oo2B93uDne6y93ucchhR9zrPvc76gEPesjDHvGoxzzumCc86binnPC0ZzzrOc876QUvesnLXvGqU0474zWve8Ob3vK2d5z1rve87wMf+sg5H/vEp877zAUXfe4Ll3zpK1/7xre+873LfvCjn/zsiquu+cWvfvO7P/zpL9f97R833PSv/wACwudxIAMAABUAFaAJFeoCFY28v7gJHBXIARUAFQgVCAAAH4sIAAAAAAAAAB3SsYFCMQxEwQ/XEFiyJPffGOdJXrST7et5nu/rP+smbvJm39RN38zNed/xR7+6NDR1a2nrKLvYxS52sYtd7GIXu9jFBhtssMEGG2ywwQYbbLLJJptssskmm2yyyW52s5vd7GY3u9nNbnazxRZbbLHFFltsscUW22yzzTbbbLPNNttss8MOO+ywww477LDDDnvYwx72sIc97GEPe9hz/nzj8wPU24atUAIAABkRAhkYCAAAAAAAAAAAGRgIYwAAAAAAAAAVAhkWAAAZEQIZGAExGRgCOTkVAhkWAAAZHBYIFaoDFgAAABkcFrIDFZ4DFgAAABUCGTxIBXRhYmxlFQQAFQQlABgBYVUCABUMJQAYAWIlADUEHBwAAAAWyAEZHBksJggcFQQZJQAIGRgBYRUEFsgBFvQMFqoDJgg8GAhjAAAAAAAAABgIAAAAAAAAAAAWACgIYwAAAAAAAAAYCAAAAAAAAAAAABkcFQAVABUCAAAWsgcVFhbQBhU+ACayAxwVDBklAAgZGAFiFQQWyAEW1AkWngMmsgM8NgAoAjk5GAExABkcFQAVABUCAAAWyAcVGBaOBxUkABbIFhbIASYIFsgGFAAAGRwYDmljZWJlcmcuc2NoZW1hGJABeyJ0eXBlIjoic3RydWN0Iiwic2NoZW1hLWlkIjowLCJmaWVsZHMiOlt7ImlkIjoxLCJuYW1lIjoiYSIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjoibG9uZyJ9LHsiaWQiOjIsIm5hbWUiOiJiIiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJzdHJpbmcifV19ABhKcGFycXVldC1tciB2ZXJzaW9uIDEuMTIuMyAoYnVpbGQgZjhkY2VkMTgyYzRjMWZiZGVjNmNjYjMxODU1MzdiNWEwMWU2ZWQ2YikZLBwAABwAAADPAQAAUEFSMQ== | base64 --decode > /iceberg_data/default/test_iceberg_snapshot_reads1_local_9ef16ce6_8487_4d44_aab2_bcabf0c395aa/data/00000-41-f99abe1d-fdc8-408d-a636-ec9a6ed71ab9-00001.parquet] (cluster.py:121, run_and_check) 2025-05-23 21:10:56 [ 671 ] DEBUG : run container_id:rootteststorageiceberg-gw1-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p /iceberg_data/default/test_iceberg_snapshot_reads1_local_9ef16ce6_8487_4d44_aab2_bcabf0c395aa/metadata'] (cluster.py:2045, exec_in_container) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command:[docker exec rootteststorageiceberg-gw1-node1-1 bash -c mkdir -p /iceberg_data/default/test_iceberg_snapshot_reads1_local_9ef16ce6_8487_4d44_aab2_bcabf0c395aa/metadata] (cluster.py:121, run_and_check) 2025-05-23 21:10:56 [ 671 ] DEBUG : run container_id:rootteststorageiceberg-gw1-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname /iceberg_data/default/test_iceberg_snapshot_reads1_local_9ef16ce6_8487_4d44_aab2_bcabf0c395aa/metadata/6db91d2a-4809-4c7e-b076-8841e7e9fdd8-m0.avro) && echo T2JqAQ4Mc2NoZW1hpAJ7InR5cGUiOiJzdHJ1Y3QiLCJzY2hlbWEtaWQiOjAsImZpZWxkcyI6W3siaWQiOjEsIm5hbWUiOiJhIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoibG9uZyJ9LHsiaWQiOjIsIm5hbWUiOiJiIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoic3RyaW5nIn1dfRZhdnJvLnNjaGVtYZYueyJ0eXBlIjoicmVjb3JkIiwibmFtZSI6Im1hbmlmZXN0X2VudHJ5IiwiZmllbGRzIjpbeyJuYW1lIjoic3RhdHVzIiwidHlwZSI6ImludCIsImZpZWxkLWlkIjowfSx7Im5hbWUiOiJzbmFwc2hvdF9pZCIsInR5cGUiOlsibnVsbCIsImxvbmciXSwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjF9LHsibmFtZSI6ImRhdGFfZmlsZSIsInR5cGUiOnsidHlwZSI6InJlY29yZCIsIm5hbWUiOiJyMiIsImZpZWxkcyI6W3sibmFtZSI6ImZpbGVfcGF0aCIsInR5cGUiOiJzdHJpbmciLCJkb2MiOiJMb2NhdGlvbiBVUkkgd2l0aCBGUyBzY2hlbWUiLCJmaWVsZC1pZCI6MTAwfSx7Im5hbWUiOiJmaWxlX2Zvcm1hdCIsInR5cGUiOiJzdHJpbmciLCJkb2MiOiJGaWxlIGZvcm1hdCBuYW1lOiBhdnJvLCBvcmMsIG9yIHBhcnF1ZXQiLCJmaWVsZC1pZCI6MTAxfSx7Im5hbWUiOiJwYXJ0aXRpb24iLCJ0eXBlIjp7InR5cGUiOiJyZWNvcmQiLCJuYW1lIjoicjEwMiIsImZpZWxkcyI6W119LCJmaWVsZC1pZCI6MTAyfSx7Im5hbWUiOiJyZWNvcmRfY291bnQiLCJ0eXBlIjoibG9uZyIsImRvYyI6Ik51bWJlciBvZiByZWNvcmRzIGluIHRoZSBmaWxlIiwiZmllbGQtaWQiOjEwM30seyJuYW1lIjoiZmlsZV9zaXplX2luX2J5dGVzIiwidHlwZSI6ImxvbmciLCJkb2MiOiJUb3RhbCBmaWxlIHNpemUgaW4gYnl0ZXMiLCJmaWVsZC1pZCI6MTA0fSx7Im5hbWUiOiJibG9ja19zaXplX2luX2J5dGVzIiwidHlwZSI6ImxvbmciLCJmaWVsZC1pZCI6MTA1fSx7Im5hbWUiOiJjb2x1bW5fc2l6ZXMiLCJ0eXBlIjpbIm51bGwiLHsidHlwZSI6ImFycmF5IiwiaXRlbXMiOnsidHlwZSI6InJlY29yZCIsIm5hbWUiOiJrMTE3X3YxMTgiLCJmaWVsZHMiOlt7Im5hbWUiOiJrZXkiLCJ0eXBlIjoiaW50IiwiZmllbGQtaWQiOjExN30seyJuYW1lIjoidmFsdWUiLCJ0eXBlIjoibG9uZyIsImZpZWxkLWlkIjoxMTh9XX0sImxvZ2ljYWxUeXBlIjoibWFwIn1dLCJkb2MiOiJNYXAgb2YgY29sdW1uIGlkIHRvIHRvdGFsIHNpemUgb24gZGlzayIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjoxMDh9LHsibmFtZSI6InZhbHVlX2NvdW50cyIsInR5cGUiOlsibnVsbCIseyJ0eXBlIjoiYXJyYXkiLCJpdGVtcyI6eyJ0eXBlIjoicmVjb3JkIiwibmFtZSI6ImsxMTlfdjEyMCIsImZpZWxkcyI6W3sibmFtZSI6ImtleSIsInR5cGUiOiJpbnQiLCJmaWVsZC1pZCI6MTE5fSx7Im5hbWUiOiJ2YWx1ZSIsInR5cGUiOiJsb25nIiwiZmllbGQtaWQiOjEyMH1dfSwibG9naWNhbFR5cGUiOiJtYXAifV0sImRvYyI6Ik1hcCBvZiBjb2x1bW4gaWQgdG8gdG90YWwgY291bnQsIGluY2x1ZGluZyBudWxsIGFuZCBOYU4iLCJkZWZhdWx0IjpudWxsLCJmaWVsZC1pZCI6MTA5fSx7Im5hbWUiOiJudWxsX3ZhbHVlX2NvdW50cyIsInR5cGUiOlsibnVsbCIseyJ0eXBlIjoiYXJyYXkiLCJpdGVtcyI6eyJ0eXBlIjoicmVjb3JkIiwibmFtZSI6ImsxMjFfdjEyMiIsImZpZWxkcyI6W3sibmFtZSI6ImtleSIsInR5cGUiOiJpbnQiLCJmaWVsZC1pZCI6MTIxfSx7Im5hbWUiOiJ2YWx1ZSIsInR5cGUiOiJsb25nIiwiZmllbGQtaWQiOjEyMn1dfSwibG9naWNhbFR5cGUiOiJtYXAifV0sImRvYyI6Ik1hcCBvZiBjb2x1bW4gaWQgdG8gbnVsbCB2YWx1ZSBjb3VudCIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjoxMTB9LHsibmFtZSI6Im5hbl92YWx1ZV9jb3VudHMiLCJ0eXBlIjpbIm51bGwiLHsidHlwZSI6ImFycmF5IiwiaXRlbXMiOnsidHlwZSI6InJlY29yZCIsIm5hbWUiOiJrMTM4X3YxMzkiLCJmaWVsZHMiOlt7Im5hbWUiOiJrZXkiLCJ0eXBlIjoiaW50IiwiZmllbGQtaWQiOjEzOH0seyJuYW1lIjoidmFsdWUiLCJ0eXBlIjoibG9uZyIsImZpZWxkLWlkIjoxMzl9XX0sImxvZ2ljYWxUeXBlIjoibWFwIn1dLCJkb2MiOiJNYXAgb2YgY29sdW1uIGlkIHRvIG51bWJlciBvZiBOYU4gdmFsdWVzIGluIHRoZSBjb2x1bW4iLCJkZWZhdWx0IjpudWxsLCJmaWVsZC1pZCI6MTM3fSx7Im5hbWUiOiJsb3dlcl9ib3VuZHMiLCJ0eXBlIjpbIm51bGwiLHsidHlwZSI6ImFycmF5IiwiaXRlbXMiOnsidHlwZSI6InJlY29yZCIsIm5hbWUiOiJrMTI2X3YxMjciLCJmaWVsZHMiOlt7Im5hbWUiOiJrZXkiLCJ0eXBlIjoiaW50IiwiZmllbGQtaWQiOjEyNn0seyJuYW1lIjoidmFsdWUiLCJ0eXBlIjoiYnl0ZXMiLCJmaWVsZC1pZCI6MTI3fV19LCJsb2dpY2FsVHlwZSI6Im1hcCJ9XSwiZG9jIjoiTWFwIG9mIGNvbHVtbiBpZCB0byBsb3dlciBib3VuZCIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjoxMjV9LHsibmFtZSI6InVwcGVyX2JvdW5kcyIsInR5cGUiOlsibnVsbCIseyJ0eXBlIjoiYXJyYXkiLCJpdGVtcyI6eyJ0eXBlIjoicmVjb3JkIiwibmFtZSI6ImsxMjlfdjEzMCIsImZpZWxkcyI6W3sibmFtZSI6ImtleSIsInR5cGUiOiJpbnQiLCJmaWVsZC1pZCI6MTI5fSx7Im5hbWUiOiJ2YWx1ZSIsInR5cGUiOiJieXRlcyIsImZpZWxkLWlkIjoxMzB9XX0sImxvZ2ljYWxUeXBlIjoibWFwIn1dLCJkb2MiOiJNYXAgb2YgY29sdW1uIGlkIHRvIHVwcGVyIGJvdW5kIiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjEyOH0seyJuYW1lIjoia2V5X21ldGFkYXRhIiwidHlwZSI6WyJudWxsIiwiYnl0ZXMiXSwiZG9jIjoiRW5jcnlwdGlvbiBrZXkgbWV0YWRhdGEgYmxvYiIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjoxMzF9LHsibmFtZSI6InNwbGl0X29mZnNldHMiLCJ0eXBlIjpbIm51bGwiLHsidHlwZSI6ImFycmF5IiwiaXRlbXMiOiJsb25nIiwiZWxlbWVudC1pZCI6MTMzfV0sImRvYyI6IlNwbGl0dGFibGUgb2Zmc2V0cyIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjoxMzJ9LHsibmFtZSI6InNvcnRfb3JkZXJfaWQiLCJ0eXBlIjpbIm51bGwiLCJpbnQiXSwiZG9jIjoiU29ydCBvcmRlciBJRCIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjoxNDB9XX0sImZpZWxkLWlkIjoyfV19FGF2cm8uY29kZWMOZGVmbGF0ZRxmb3JtYXQtdmVyc2lvbgIxInBhcnRpdGlvbi1zcGVjLWlkAjAcaWNlYmVyZy5zY2hlbWHqJHsidHlwZSI6InN0cnVjdCIsInNjaGVtYS1pZCI6MCwiZmllbGRzIjpbeyJpZCI6MCwibmFtZSI6InN0YXR1cyIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjoiaW50In0seyJpZCI6MSwibmFtZSI6InNuYXBzaG90X2lkIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoibG9uZyJ9LHsiaWQiOjIsIm5hbWUiOiJkYXRhX2ZpbGUiLCJyZXF1aXJlZCI6dHJ1ZSwidHlwZSI6eyJ0eXBlIjoic3RydWN0IiwiZmllbGRzIjpbeyJpZCI6MTAwLCJuYW1lIjoiZmlsZV9wYXRoIiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJzdHJpbmciLCJkb2MiOiJMb2NhdGlvbiBVUkkgd2l0aCBGUyBzY2hlbWUifSx7ImlkIjoxMDEsIm5hbWUiOiJmaWxlX2Zvcm1hdCIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjoic3RyaW5nIiwiZG9jIjoiRmlsZSBmb3JtYXQgbmFtZTogYXZybywgb3JjLCBvciBwYXJxdWV0In0seyJpZCI6MTAyLCJuYW1lIjoicGFydGl0aW9uIiwicmVxdWlyZWQiOnRydWUsInR5cGUiOnsidHlwZSI6InN0cnVjdCIsImZpZWxkcyI6W119fSx7ImlkIjoxMDMsIm5hbWUiOiJyZWNvcmRfY291bnQiLCJyZXF1aXJlZCI6dHJ1ZSwidHlwZSI6ImxvbmciLCJkb2MiOiJOdW1iZXIgb2YgcmVjb3JkcyBpbiB0aGUgZmlsZSJ9LHsiaWQiOjEwNCwibmFtZSI6ImZpbGVfc2l6ZV9pbl9ieXRlcyIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjoibG9uZyIsImRvYyI6IlRvdGFsIGZpbGUgc2l6ZSBpbiBieXRlcyJ9LHsiaWQiOjEwNSwibmFtZSI6ImJsb2NrX3NpemVfaW5fYnl0ZXMiLCJyZXF1aXJlZCI6dHJ1ZSwidHlwZSI6ImxvbmcifSx7ImlkIjoxMDgsIm5hbWUiOiJjb2x1bW5fc2l6ZXMiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOnsidHlwZSI6Im1hcCIsImtleS1pZCI6MTE3LCJrZXkiOiJpbnQiLCJ2YWx1ZS1pZCI6MTE4LCJ2YWx1ZSI6ImxvbmciLCJ2YWx1ZS1yZXF1aXJlZCI6dHJ1ZX0sImRvYyI6Ik1hcCBvZiBjb2x1bW4gaWQgdG8gdG90YWwgc2l6ZSBvbiBkaXNrIn0seyJpZCI6MTA5LCJuYW1lIjoidmFsdWVfY291bnRzIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjp7InR5cGUiOiJtYXAiLCJrZXktaWQiOjExOSwia2V5IjoiaW50IiwidmFsdWUtaWQiOjEyMCwidmFsdWUiOiJsb25nIiwidmFsdWUtcmVxdWlyZWQiOnRydWV9LCJkb2MiOiJNYXAgb2YgY29sdW1uIGlkIHRvIHRvdGFsIGNvdW50LCBpbmNsdWRpbmcgbnVsbCBhbmQgTmFOIn0seyJpZCI6MTEwLCJuYW1lIjoibnVsbF92YWx1ZV9jb3VudHMiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOnsidHlwZSI6Im1hcCIsImtleS1pZCI6MTIxLCJrZXkiOiJpbnQiLCJ2YWx1ZS1pZCI6MTIyLCJ2YWx1ZSI6ImxvbmciLCJ2YWx1ZS1yZXF1aXJlZCI6dHJ1ZX0sImRvYyI6Ik1hcCBvZiBjb2x1bW4gaWQgdG8gbnVsbCB2YWx1ZSBjb3VudCJ9LHsiaWQiOjEzNywibmFtZSI6Im5hbl92YWx1ZV9jb3VudHMiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOnsidHlwZSI6Im1hcCIsImtleS1pZCI6MTM4LCJrZXkiOiJpbnQiLCJ2YWx1ZS1pZCI6MTM5LCJ2YWx1ZSI6ImxvbmciLCJ2YWx1ZS1yZXF1aXJlZCI6dHJ1ZX0sImRvYyI6Ik1hcCBvZiBjb2x1bW4gaWQgdG8gbnVtYmVyIG9mIE5hTiB2YWx1ZXMgaW4gdGhlIGNvbHVtbiJ9LHsiaWQiOjEyNSwibmFtZSI6Imxvd2VyX2JvdW5kcyIsInJlcXVpcmVkIjpmYWxzZSwidHlwZSI6eyJ0eXBlIjoibWFwIiwia2V5LWlkIjoxMjYsImtleSI6ImludCIsInZhbHVlLWlkIjoxMjcsInZhbHVlIjoiYmluYXJ5IiwidmFsdWUtcmVxdWlyZWQiOnRydWV9LCJkb2MiOiJNYXAgb2YgY29sdW1uIGlkIHRvIGxvd2VyIGJvdW5kIn0seyJpZCI6MTI4LCJuYW1lIjoidXBwZXJfYm91bmRzIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjp7InR5cGUiOiJtYXAiLCJrZXktaWQiOjEyOSwia2V5IjoiaW50IiwidmFsdWUtaWQiOjEzMCwidmFsdWUiOiJiaW5hcnkiLCJ2YWx1ZS1yZXF1aXJlZCI6dHJ1ZX0sImRvYyI6Ik1hcCBvZiBjb2x1bW4gaWQgdG8gdXBwZXIgYm91bmQifSx7ImlkIjoxMzEsIm5hbWUiOiJrZXlfbWV0YWRhdGEiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOiJiaW5hcnkiLCJkb2MiOiJFbmNyeXB0aW9uIGtleSBtZXRhZGF0YSBibG9iIn0seyJpZCI6MTMyLCJuYW1lIjoic3BsaXRfb2Zmc2V0cyIsInJlcXVpcmVkIjpmYWxzZSwidHlwZSI6eyJ0eXBlIjoibGlzdCIsImVsZW1lbnQtaWQiOjEzMywiZWxlbWVudCI6ImxvbmciLCJlbGVtZW50LXJlcXVpcmVkIjp0cnVlfSwiZG9jIjoiU3BsaXR0YWJsZSBvZmZzZXRzIn0seyJpZCI6MTQwLCJuYW1lIjoic29ydF9vcmRlcl9pZCIsInJlcXVpcmVkIjpmYWxzZSwidHlwZSI6ImludCIsImRvYyI6IlNvcnQgb3JkZXIgSUQifV19fV19HHBhcnRpdGlvbi1zcGVjBFtdAOdB3YchHufMA5pFk8PCeK4CrAM1jLFOwzAURR3XAxPlR0xi6rrxBgM7IDo/PdvPBSmiJXH3rJUQn4DEhvgGJNYM/RM2voAYtXc6V/focr7//fje7V5+3osvXj56ctSuIGDCMlDEbZPKRF2C49I94aZ7WCdoCUOnoFl7bMBSVMaTgVrXC9BBa0B0F+A8ulj5mZ3j+JdPqxyplYzWoiMVZAy+lrqqg0QzM5K8RUNhodBZmWV1vsH2eUvp9Obq7nZ5fT8Ur9O+7y+54J8T8TZhIwyFGIoMTDDGM5yxQwRX/90fu7B2dPjJ6P0B50HdhyEe58wDmkWTw8J4rg== | base64 --decode > /iceberg_data/default/test_iceberg_snapshot_reads1_local_9ef16ce6_8487_4d44_aab2_bcabf0c395aa/metadata/6db91d2a-4809-4c7e-b076-8841e7e9fdd8-m0.avro'] (cluster.py:2045, exec_in_container) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command:[docker exec rootteststorageiceberg-gw1-node1-1 bash -c mkdir -p $(dirname /iceberg_data/default/test_iceberg_snapshot_reads1_local_9ef16ce6_8487_4d44_aab2_bcabf0c395aa/metadata/6db91d2a-4809-4c7e-b076-8841e7e9fdd8-m0.avro) && echo T2JqAQ4Mc2NoZW1hpAJ7InR5cGUiOiJzdHJ1Y3QiLCJzY2hlbWEtaWQiOjAsImZpZWxkcyI6W3siaWQiOjEsIm5hbWUiOiJhIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoibG9uZyJ9LHsiaWQiOjIsIm5hbWUiOiJiIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoic3RyaW5nIn1dfRZhdnJvLnNjaGVtYZYueyJ0eXBlIjoicmVjb3JkIiwibmFtZSI6Im1hbmlmZXN0X2VudHJ5IiwiZmllbGRzIjpbeyJuYW1lIjoic3RhdHVzIiwidHlwZSI6ImludCIsImZpZWxkLWlkIjowfSx7Im5hbWUiOiJzbmFwc2hvdF9pZCIsInR5cGUiOlsibnVsbCIsImxvbmciXSwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjF9LHsibmFtZSI6ImRhdGFfZmlsZSIsInR5cGUiOnsidHlwZSI6InJlY29yZCIsIm5hbWUiOiJyMiIsImZpZWxkcyI6W3sibmFtZSI6ImZpbGVfcGF0aCIsInR5cGUiOiJzdHJpbmciLCJkb2MiOiJMb2NhdGlvbiBVUkkgd2l0aCBGUyBzY2hlbWUiLCJmaWVsZC1pZCI6MTAwfSx7Im5hbWUiOiJmaWxlX2Zvcm1hdCIsInR5cGUiOiJzdHJpbmciLCJkb2MiOiJGaWxlIGZvcm1hdCBuYW1lOiBhdnJvLCBvcmMsIG9yIHBhcnF1ZXQiLCJmaWVsZC1pZCI6MTAxfSx7Im5hbWUiOiJwYXJ0aXRpb24iLCJ0eXBlIjp7InR5cGUiOiJyZWNvcmQiLCJuYW1lIjoicjEwMiIsImZpZWxkcyI6W119LCJmaWVsZC1pZCI6MTAyfSx7Im5hbWUiOiJyZWNvcmRfY291bnQiLCJ0eXBlIjoibG9uZyIsImRvYyI6Ik51bWJlciBvZiByZWNvcmRzIGluIHRoZSBmaWxlIiwiZmllbGQtaWQiOjEwM30seyJuYW1lIjoiZmlsZV9zaXplX2luX2J5dGVzIiwidHlwZSI6ImxvbmciLCJkb2MiOiJUb3RhbCBmaWxlIHNpemUgaW4gYnl0ZXMiLCJmaWVsZC1pZCI6MTA0fSx7Im5hbWUiOiJibG9ja19zaXplX2luX2J5dGVzIiwidHlwZSI6ImxvbmciLCJmaWVsZC1pZCI6MTA1fSx7Im5hbWUiOiJjb2x1bW5fc2l6ZXMiLCJ0eXBlIjpbIm51bGwiLHsidHlwZSI6ImFycmF5IiwiaXRlbXMiOnsidHlwZSI6InJlY29yZCIsIm5hbWUiOiJrMTE3X3YxMTgiLCJmaWVsZHMiOlt7Im5hbWUiOiJrZXkiLCJ0eXBlIjoiaW50IiwiZmllbGQtaWQiOjExN30seyJuYW1lIjoidmFsdWUiLCJ0eXBlIjoibG9uZyIsImZpZWxkLWlkIjoxMTh9XX0sImxvZ2ljYWxUeXBlIjoibWFwIn1dLCJkb2MiOiJNYXAgb2YgY29sdW1uIGlkIHRvIHRvdGFsIHNpemUgb24gZGlzayIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjoxMDh9LHsibmFtZSI6InZhbHVlX2NvdW50cyIsInR5cGUiOlsibnVsbCIseyJ0eXBlIjoiYXJyYXkiLCJpdGVtcyI6eyJ0eXBlIjoicmVjb3JkIiwibmFtZSI6ImsxMTlfdjEyMCIsImZpZWxkcyI6W3sibmFtZSI6ImtleSIsInR5cGUiOiJpbnQiLCJmaWVsZC1pZCI6MTE5fSx7Im5hbWUiOiJ2YWx1ZSIsInR5cGUiOiJsb25nIiwiZmllbGQtaWQiOjEyMH1dfSwibG9naWNhbFR5cGUiOiJtYXAifV0sImRvYyI6Ik1hcCBvZiBjb2x1bW4gaWQgdG8gdG90YWwgY291bnQsIGluY2x1ZGluZyBudWxsIGFuZCBOYU4iLCJkZWZhdWx0IjpudWxsLCJmaWVsZC1pZCI6MTA5fSx7Im5hbWUiOiJudWxsX3ZhbHVlX2NvdW50cyIsInR5cGUiOlsibnVsbCIseyJ0eXBlIjoiYXJyYXkiLCJpdGVtcyI6eyJ0eXBlIjoicmVjb3JkIiwibmFtZSI6ImsxMjFfdjEyMiIsImZpZWxkcyI6W3sibmFtZSI6ImtleSIsInR5cGUiOiJpbnQiLCJmaWVsZC1pZCI6MTIxfSx7Im5hbWUiOiJ2YWx1ZSIsInR5cGUiOiJsb25nIiwiZmllbGQtaWQiOjEyMn1dfSwibG9naWNhbFR5cGUiOiJtYXAifV0sImRvYyI6Ik1hcCBvZiBjb2x1bW4gaWQgdG8gbnVsbCB2YWx1ZSBjb3VudCIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjoxMTB9LHsibmFtZSI6Im5hbl92YWx1ZV9jb3VudHMiLCJ0eXBlIjpbIm51bGwiLHsidHlwZSI6ImFycmF5IiwiaXRlbXMiOnsidHlwZSI6InJlY29yZCIsIm5hbWUiOiJrMTM4X3YxMzkiLCJmaWVsZHMiOlt7Im5hbWUiOiJrZXkiLCJ0eXBlIjoiaW50IiwiZmllbGQtaWQiOjEzOH0seyJuYW1lIjoidmFsdWUiLCJ0eXBlIjoibG9uZyIsImZpZWxkLWlkIjoxMzl9XX0sImxvZ2ljYWxUeXBlIjoibWFwIn1dLCJkb2MiOiJNYXAgb2YgY29sdW1uIGlkIHRvIG51bWJlciBvZiBOYU4gdmFsdWVzIGluIHRoZSBjb2x1bW4iLCJkZWZhdWx0IjpudWxsLCJmaWVsZC1pZCI6MTM3fSx7Im5hbWUiOiJsb3dlcl9ib3VuZHMiLCJ0eXBlIjpbIm51bGwiLHsidHlwZSI6ImFycmF5IiwiaXRlbXMiOnsidHlwZSI6InJlY29yZCIsIm5hbWUiOiJrMTI2X3YxMjciLCJmaWVsZHMiOlt7Im5hbWUiOiJrZXkiLCJ0eXBlIjoiaW50IiwiZmllbGQtaWQiOjEyNn0seyJuYW1lIjoidmFsdWUiLCJ0eXBlIjoiYnl0ZXMiLCJmaWVsZC1pZCI6MTI3fV19LCJsb2dpY2FsVHlwZSI6Im1hcCJ9XSwiZG9jIjoiTWFwIG9mIGNvbHVtbiBpZCB0byBsb3dlciBib3VuZCIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjoxMjV9LHsibmFtZSI6InVwcGVyX2JvdW5kcyIsInR5cGUiOlsibnVsbCIseyJ0eXBlIjoiYXJyYXkiLCJpdGVtcyI6eyJ0eXBlIjoicmVjb3JkIiwibmFtZSI6ImsxMjlfdjEzMCIsImZpZWxkcyI6W3sibmFtZSI6ImtleSIsInR5cGUiOiJpbnQiLCJmaWVsZC1pZCI6MTI5fSx7Im5hbWUiOiJ2YWx1ZSIsInR5cGUiOiJieXRlcyIsImZpZWxkLWlkIjoxMzB9XX0sImxvZ2ljYWxUeXBlIjoibWFwIn1dLCJkb2MiOiJNYXAgb2YgY29sdW1uIGlkIHRvIHVwcGVyIGJvdW5kIiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjEyOH0seyJuYW1lIjoia2V5X21ldGFkYXRhIiwidHlwZSI6WyJudWxsIiwiYnl0ZXMiXSwiZG9jIjoiRW5jcnlwdGlvbiBrZXkgbWV0YWRhdGEgYmxvYiIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjoxMzF9LHsibmFtZSI6InNwbGl0X29mZnNldHMiLCJ0eXBlIjpbIm51bGwiLHsidHlwZSI6ImFycmF5IiwiaXRlbXMiOiJsb25nIiwiZWxlbWVudC1pZCI6MTMzfV0sImRvYyI6IlNwbGl0dGFibGUgb2Zmc2V0cyIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjoxMzJ9LHsibmFtZSI6InNvcnRfb3JkZXJfaWQiLCJ0eXBlIjpbIm51bGwiLCJpbnQiXSwiZG9jIjoiU29ydCBvcmRlciBJRCIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjoxNDB9XX0sImZpZWxkLWlkIjoyfV19FGF2cm8uY29kZWMOZGVmbGF0ZRxmb3JtYXQtdmVyc2lvbgIxInBhcnRpdGlvbi1zcGVjLWlkAjAcaWNlYmVyZy5zY2hlbWHqJHsidHlwZSI6InN0cnVjdCIsInNjaGVtYS1pZCI6MCwiZmllbGRzIjpbeyJpZCI6MCwibmFtZSI6InN0YXR1cyIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjoiaW50In0seyJpZCI6MSwibmFtZSI6InNuYXBzaG90X2lkIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoibG9uZyJ9LHsiaWQiOjIsIm5hbWUiOiJkYXRhX2ZpbGUiLCJyZXF1aXJlZCI6dHJ1ZSwidHlwZSI6eyJ0eXBlIjoic3RydWN0IiwiZmllbGRzIjpbeyJpZCI6MTAwLCJuYW1lIjoiZmlsZV9wYXRoIiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJzdHJpbmciLCJkb2MiOiJMb2NhdGlvbiBVUkkgd2l0aCBGUyBzY2hlbWUifSx7ImlkIjoxMDEsIm5hbWUiOiJmaWxlX2Zvcm1hdCIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjoic3RyaW5nIiwiZG9jIjoiRmlsZSBmb3JtYXQgbmFtZTogYXZybywgb3JjLCBvciBwYXJxdWV0In0seyJpZCI6MTAyLCJuYW1lIjoicGFydGl0aW9uIiwicmVxdWlyZWQiOnRydWUsInR5cGUiOnsidHlwZSI6InN0cnVjdCIsImZpZWxkcyI6W119fSx7ImlkIjoxMDMsIm5hbWUiOiJyZWNvcmRfY291bnQiLCJyZXF1aXJlZCI6dHJ1ZSwidHlwZSI6ImxvbmciLCJkb2MiOiJOdW1iZXIgb2YgcmVjb3JkcyBpbiB0aGUgZmlsZSJ9LHsiaWQiOjEwNCwibmFtZSI6ImZpbGVfc2l6ZV9pbl9ieXRlcyIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjoibG9uZyIsImRvYyI6IlRvdGFsIGZpbGUgc2l6ZSBpbiBieXRlcyJ9LHsiaWQiOjEwNSwibmFtZSI6ImJsb2NrX3NpemVfaW5fYnl0ZXMiLCJyZXF1aXJlZCI6dHJ1ZSwidHlwZSI6ImxvbmcifSx7ImlkIjoxMDgsIm5hbWUiOiJjb2x1bW5fc2l6ZXMiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOnsidHlwZSI6Im1hcCIsImtleS1pZCI6MTE3LCJrZXkiOiJpbnQiLCJ2YWx1ZS1pZCI6MTE4LCJ2YWx1ZSI6ImxvbmciLCJ2YWx1ZS1yZXF1aXJlZCI6dHJ1ZX0sImRvYyI6Ik1hcCBvZiBjb2x1bW4gaWQgdG8gdG90YWwgc2l6ZSBvbiBkaXNrIn0seyJpZCI6MTA5LCJuYW1lIjoidmFsdWVfY291bnRzIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjp7InR5cGUiOiJtYXAiLCJrZXktaWQiOjExOSwia2V5IjoiaW50IiwidmFsdWUtaWQiOjEyMCwidmFsdWUiOiJsb25nIiwidmFsdWUtcmVxdWlyZWQiOnRydWV9LCJkb2MiOiJNYXAgb2YgY29sdW1uIGlkIHRvIHRvdGFsIGNvdW50LCBpbmNsdWRpbmcgbnVsbCBhbmQgTmFOIn0seyJpZCI6MTEwLCJuYW1lIjoibnVsbF92YWx1ZV9jb3VudHMiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOnsidHlwZSI6Im1hcCIsImtleS1pZCI6MTIxLCJrZXkiOiJpbnQiLCJ2YWx1ZS1pZCI6MTIyLCJ2YWx1ZSI6ImxvbmciLCJ2YWx1ZS1yZXF1aXJlZCI6dHJ1ZX0sImRvYyI6Ik1hcCBvZiBjb2x1bW4gaWQgdG8gbnVsbCB2YWx1ZSBjb3VudCJ9LHsiaWQiOjEzNywibmFtZSI6Im5hbl92YWx1ZV9jb3VudHMiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOnsidHlwZSI6Im1hcCIsImtleS1pZCI6MTM4LCJrZXkiOiJpbnQiLCJ2YWx1ZS1pZCI6MTM5LCJ2YWx1ZSI6ImxvbmciLCJ2YWx1ZS1yZXF1aXJlZCI6dHJ1ZX0sImRvYyI6Ik1hcCBvZiBjb2x1bW4gaWQgdG8gbnVtYmVyIG9mIE5hTiB2YWx1ZXMgaW4gdGhlIGNvbHVtbiJ9LHsiaWQiOjEyNSwibmFtZSI6Imxvd2VyX2JvdW5kcyIsInJlcXVpcmVkIjpmYWxzZSwidHlwZSI6eyJ0eXBlIjoibWFwIiwia2V5LWlkIjoxMjYsImtleSI6ImludCIsInZhbHVlLWlkIjoxMjcsInZhbHVlIjoiYmluYXJ5IiwidmFsdWUtcmVxdWlyZWQiOnRydWV9LCJkb2MiOiJNYXAgb2YgY29sdW1uIGlkIHRvIGxvd2VyIGJvdW5kIn0seyJpZCI6MTI4LCJuYW1lIjoidXBwZXJfYm91bmRzIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjp7InR5cGUiOiJtYXAiLCJrZXktaWQiOjEyOSwia2V5IjoiaW50IiwidmFsdWUtaWQiOjEzMCwidmFsdWUiOiJiaW5hcnkiLCJ2YWx1ZS1yZXF1aXJlZCI6dHJ1ZX0sImRvYyI6Ik1hcCBvZiBjb2x1bW4gaWQgdG8gdXBwZXIgYm91bmQifSx7ImlkIjoxMzEsIm5hbWUiOiJrZXlfbWV0YWRhdGEiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOiJiaW5hcnkiLCJkb2MiOiJFbmNyeXB0aW9uIGtleSBtZXRhZGF0YSBibG9iIn0seyJpZCI6MTMyLCJuYW1lIjoic3BsaXRfb2Zmc2V0cyIsInJlcXVpcmVkIjpmYWxzZSwidHlwZSI6eyJ0eXBlIjoibGlzdCIsImVsZW1lbnQtaWQiOjEzMywiZWxlbWVudCI6ImxvbmciLCJlbGVtZW50LXJlcXVpcmVkIjp0cnVlfSwiZG9jIjoiU3BsaXR0YWJsZSBvZmZzZXRzIn0seyJpZCI6MTQwLCJuYW1lIjoic29ydF9vcmRlcl9pZCIsInJlcXVpcmVkIjpmYWxzZSwidHlwZSI6ImludCIsImRvYyI6IlNvcnQgb3JkZXIgSUQifV19fV19HHBhcnRpdGlvbi1zcGVjBFtdAOdB3YchHufMA5pFk8PCeK4CrAM1jLFOwzAURR3XAxPlR0xi6rrxBgM7IDo/PdvPBSmiJXH3rJUQn4DEhvgGJNYM/RM2voAYtXc6V/focr7//fje7V5+3osvXj56ctSuIGDCMlDEbZPKRF2C49I94aZ7WCdoCUOnoFl7bMBSVMaTgVrXC9BBa0B0F+A8ulj5mZ3j+JdPqxyplYzWoiMVZAy+lrqqg0QzM5K8RUNhodBZmWV1vsH2eUvp9Obq7nZ5fT8Ur9O+7y+54J8T8TZhIwyFGIoMTDDGM5yxQwRX/90fu7B2dPjJ6P0B50HdhyEe58wDmkWTw8J4rg== | base64 --decode > /iceberg_data/default/test_iceberg_snapshot_reads1_local_9ef16ce6_8487_4d44_aab2_bcabf0c395aa/metadata/6db91d2a-4809-4c7e-b076-8841e7e9fdd8-m0.avro] (cluster.py:121, run_and_check) 2025-05-23 21:10:56 [ 671 ] DEBUG : run container_id:rootteststorageiceberg-gw1-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p /iceberg_data/default/test_iceberg_snapshot_reads1_local_9ef16ce6_8487_4d44_aab2_bcabf0c395aa/metadata'] (cluster.py:2045, exec_in_container) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command:[docker exec rootteststorageiceberg-gw1-node1-1 bash -c mkdir -p /iceberg_data/default/test_iceberg_snapshot_reads1_local_9ef16ce6_8487_4d44_aab2_bcabf0c395aa/metadata] (cluster.py:121, run_and_check) 2025-05-23 21:10:56 [ 671 ] DEBUG : run container_id:rootteststorageiceberg-gw1-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname /iceberg_data/default/test_iceberg_snapshot_reads1_local_9ef16ce6_8487_4d44_aab2_bcabf0c395aa/metadata/snap-5830780686733483174-1-6db91d2a-4809-4c7e-b076-8841e7e9fdd8.avro) && echo T2JqAQwWYXZyby5zY2hlbWH6G3sidHlwZSI6InJlY29yZCIsIm5hbWUiOiJtYW5pZmVzdF9maWxlIiwiZmllbGRzIjpbeyJuYW1lIjoibWFuaWZlc3RfcGF0aCIsInR5cGUiOiJzdHJpbmciLCJkb2MiOiJMb2NhdGlvbiBVUkkgd2l0aCBGUyBzY2hlbWUiLCJmaWVsZC1pZCI6NTAwfSx7Im5hbWUiOiJtYW5pZmVzdF9sZW5ndGgiLCJ0eXBlIjoibG9uZyIsImRvYyI6IlRvdGFsIGZpbGUgc2l6ZSBpbiBieXRlcyIsImZpZWxkLWlkIjo1MDF9LHsibmFtZSI6InBhcnRpdGlvbl9zcGVjX2lkIiwidHlwZSI6ImludCIsImRvYyI6IlNwZWMgSUQgdXNlZCB0byB3cml0ZSIsImZpZWxkLWlkIjo1MDJ9LHsibmFtZSI6ImFkZGVkX3NuYXBzaG90X2lkIiwidHlwZSI6WyJudWxsIiwibG9uZyJdLCJkb2MiOiJTbmFwc2hvdCBJRCB0aGF0IGFkZGVkIHRoZSBtYW5pZmVzdCIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjo1MDN9LHsibmFtZSI6ImFkZGVkX2RhdGFfZmlsZXNfY291bnQiLCJ0eXBlIjpbIm51bGwiLCJpbnQiXSwiZG9jIjoiQWRkZWQgZW50cnkgY291bnQiLCJkZWZhdWx0IjpudWxsLCJmaWVsZC1pZCI6NTA0fSx7Im5hbWUiOiJleGlzdGluZ19kYXRhX2ZpbGVzX2NvdW50IiwidHlwZSI6WyJudWxsIiwiaW50Il0sImRvYyI6IkV4aXN0aW5nIGVudHJ5IGNvdW50IiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjUwNX0seyJuYW1lIjoiZGVsZXRlZF9kYXRhX2ZpbGVzX2NvdW50IiwidHlwZSI6WyJudWxsIiwiaW50Il0sImRvYyI6IkRlbGV0ZWQgZW50cnkgY291bnQiLCJkZWZhdWx0IjpudWxsLCJmaWVsZC1pZCI6NTA2fSx7Im5hbWUiOiJwYXJ0aXRpb25zIiwidHlwZSI6WyJudWxsIix7InR5cGUiOiJhcnJheSIsIml0ZW1zIjp7InR5cGUiOiJyZWNvcmQiLCJuYW1lIjoicjUwOCIsImZpZWxkcyI6W3sibmFtZSI6ImNvbnRhaW5zX251bGwiLCJ0eXBlIjoiYm9vbGVhbiIsImRvYyI6IlRydWUgaWYgYW55IGZpbGUgaGFzIGEgbnVsbCBwYXJ0aXRpb24gdmFsdWUiLCJmaWVsZC1pZCI6NTA5fSx7Im5hbWUiOiJjb250YWluc19uYW4iLCJ0eXBlIjpbIm51bGwiLCJib29sZWFuIl0sImRvYyI6IlRydWUgaWYgYW55IGZpbGUgaGFzIGEgbmFuIHBhcnRpdGlvbiB2YWx1ZSIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjo1MTh9LHsibmFtZSI6Imxvd2VyX2JvdW5kIiwidHlwZSI6WyJudWxsIiwiYnl0ZXMiXSwiZG9jIjoiUGFydGl0aW9uIGxvd2VyIGJvdW5kIGZvciBhbGwgZmlsZXMiLCJkZWZhdWx0IjpudWxsLCJmaWVsZC1pZCI6NTEwfSx7Im5hbWUiOiJ1cHBlcl9ib3VuZCIsInR5cGUiOlsibnVsbCIsImJ5dGVzIl0sImRvYyI6IlBhcnRpdGlvbiB1cHBlciBib3VuZCBmb3IgYWxsIGZpbGVzIiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjUxMX1dfSwiZWxlbWVudC1pZCI6NTA4fV0sImRvYyI6IlN1bW1hcnkgZm9yIGVhY2ggcGFydGl0aW9uIiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjUwN30seyJuYW1lIjoiYWRkZWRfcm93c19jb3VudCIsInR5cGUiOlsibnVsbCIsImxvbmciXSwiZG9jIjoiQWRkZWQgcm93cyBjb3VudCIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjo1MTJ9LHsibmFtZSI6ImV4aXN0aW5nX3Jvd3NfY291bnQiLCJ0eXBlIjpbIm51bGwiLCJsb25nIl0sImRvYyI6IkV4aXN0aW5nIHJvd3MgY291bnQiLCJkZWZhdWx0IjpudWxsLCJmaWVsZC1pZCI6NTEzfSx7Im5hbWUiOiJkZWxldGVkX3Jvd3NfY291bnQiLCJ0eXBlIjpbIm51bGwiLCJsb25nIl0sImRvYyI6IkRlbGV0ZWQgcm93cyBjb3VudCIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjo1MTR9XX0UYXZyby5jb2RlYw5kZWZsYXRlFnNuYXBzaG90LWlkJjU4MzA3ODA2ODY3MzM0ODMxNzQcZm9ybWF0LXZlcnNpb24CMRxpY2ViZXJnLnNjaGVtYbQaeyJ0eXBlIjoic3RydWN0Iiwic2NoZW1hLWlkIjowLCJmaWVsZHMiOlt7ImlkIjo1MDAsIm5hbWUiOiJtYW5pZmVzdF9wYXRoIiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJzdHJpbmciLCJkb2MiOiJMb2NhdGlvbiBVUkkgd2l0aCBGUyBzY2hlbWUifSx7ImlkIjo1MDEsIm5hbWUiOiJtYW5pZmVzdF9sZW5ndGgiLCJyZXF1aXJlZCI6dHJ1ZSwidHlwZSI6ImxvbmciLCJkb2MiOiJUb3RhbCBmaWxlIHNpemUgaW4gYnl0ZXMifSx7ImlkIjo1MDIsIm5hbWUiOiJwYXJ0aXRpb25fc3BlY19pZCIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjoiaW50IiwiZG9jIjoiU3BlYyBJRCB1c2VkIHRvIHdyaXRlIn0seyJpZCI6NTAzLCJuYW1lIjoiYWRkZWRfc25hcHNob3RfaWQiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOiJsb25nIiwiZG9jIjoiU25hcHNob3QgSUQgdGhhdCBhZGRlZCB0aGUgbWFuaWZlc3QifSx7ImlkIjo1MDQsIm5hbWUiOiJhZGRlZF9kYXRhX2ZpbGVzX2NvdW50IiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoiaW50IiwiZG9jIjoiQWRkZWQgZW50cnkgY291bnQifSx7ImlkIjo1MDUsIm5hbWUiOiJleGlzdGluZ19kYXRhX2ZpbGVzX2NvdW50IiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoiaW50IiwiZG9jIjoiRXhpc3RpbmcgZW50cnkgY291bnQifSx7ImlkIjo1MDYsIm5hbWUiOiJkZWxldGVkX2RhdGFfZmlsZXNfY291bnQiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOiJpbnQiLCJkb2MiOiJEZWxldGVkIGVudHJ5IGNvdW50In0seyJpZCI6NTA3LCJuYW1lIjoicGFydGl0aW9ucyIsInJlcXVpcmVkIjpmYWxzZSwidHlwZSI6eyJ0eXBlIjoibGlzdCIsImVsZW1lbnQtaWQiOjUwOCwiZWxlbWVudCI6eyJ0eXBlIjoic3RydWN0IiwiZmllbGRzIjpbeyJpZCI6NTA5LCJuYW1lIjoiY29udGFpbnNfbnVsbCIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjoiYm9vbGVhbiIsImRvYyI6IlRydWUgaWYgYW55IGZpbGUgaGFzIGEgbnVsbCBwYXJ0aXRpb24gdmFsdWUifSx7ImlkIjo1MTgsIm5hbWUiOiJjb250YWluc19uYW4iLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOiJib29sZWFuIiwiZG9jIjoiVHJ1ZSBpZiBhbnkgZmlsZSBoYXMgYSBuYW4gcGFydGl0aW9uIHZhbHVlIn0seyJpZCI6NTEwLCJuYW1lIjoibG93ZXJfYm91bmQiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOiJiaW5hcnkiLCJkb2MiOiJQYXJ0aXRpb24gbG93ZXIgYm91bmQgZm9yIGFsbCBmaWxlcyJ9LHsiaWQiOjUxMSwibmFtZSI6InVwcGVyX2JvdW5kIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoiYmluYXJ5IiwiZG9jIjoiUGFydGl0aW9uIHVwcGVyIGJvdW5kIGZvciBhbGwgZmlsZXMifV19LCJlbGVtZW50LXJlcXVpcmVkIjp0cnVlfSwiZG9jIjoiU3VtbWFyeSBmb3IgZWFjaCBwYXJ0aXRpb24ifSx7ImlkIjo1MTIsIm5hbWUiOiJhZGRlZF9yb3dzX2NvdW50IiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoibG9uZyIsImRvYyI6IkFkZGVkIHJvd3MgY291bnQifSx7ImlkIjo1MTMsIm5hbWUiOiJleGlzdGluZ19yb3dzX2NvdW50IiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoibG9uZyIsImRvYyI6IkV4aXN0aW5nIHJvd3MgY291bnQifSx7ImlkIjo1MTQsIm5hbWUiOiJkZWxldGVkX3Jvd3NfY291bnQiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOiJsb25nIiwiZG9jIjoiRGVsZXRlZCByb3dzIGNvdW50In1dfSRwYXJlbnQtc25hcHNob3QtaWQIbnVsbAAjsPlkS8eogm8bMYt4jmEOArYCNYxLCsIwFADb3CemqTGfs7h4vCQvKrRWmugRhIKXcCPewq0Lb+LOE4gFmcUsBubGxC6Qp3EDEQuKSAmPXRGFcoF/yXs85O1QYCSMWUI3BOzAUZI6kAarrAEVlQJE34IP6FMTlm6FKHoqOI919E7GFrmyjeMqGOK+MZpbqyQZcilGy/tmgadxOK8r9vrcH9N0eV9rxlg186x/+gIjsPlkS8eogm8bMYt4jmEO | base64 --decode > /iceberg_data/default/test_iceberg_snapshot_reads1_local_9ef16ce6_8487_4d44_aab2_bcabf0c395aa/metadata/snap-5830780686733483174-1-6db91d2a-4809-4c7e-b076-8841e7e9fdd8.avro'] (cluster.py:2045, exec_in_container) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command:[docker exec rootteststorageiceberg-gw1-node1-1 bash -c mkdir -p $(dirname /iceberg_data/default/test_iceberg_snapshot_reads1_local_9ef16ce6_8487_4d44_aab2_bcabf0c395aa/metadata/snap-5830780686733483174-1-6db91d2a-4809-4c7e-b076-8841e7e9fdd8.avro) && echo T2JqAQwWYXZyby5zY2hlbWH6G3sidHlwZSI6InJlY29yZCIsIm5hbWUiOiJtYW5pZmVzdF9maWxlIiwiZmllbGRzIjpbeyJuYW1lIjoibWFuaWZlc3RfcGF0aCIsInR5cGUiOiJzdHJpbmciLCJkb2MiOiJMb2NhdGlvbiBVUkkgd2l0aCBGUyBzY2hlbWUiLCJmaWVsZC1pZCI6NTAwfSx7Im5hbWUiOiJtYW5pZmVzdF9sZW5ndGgiLCJ0eXBlIjoibG9uZyIsImRvYyI6IlRvdGFsIGZpbGUgc2l6ZSBpbiBieXRlcyIsImZpZWxkLWlkIjo1MDF9LHsibmFtZSI6InBhcnRpdGlvbl9zcGVjX2lkIiwidHlwZSI6ImludCIsImRvYyI6IlNwZWMgSUQgdXNlZCB0byB3cml0ZSIsImZpZWxkLWlkIjo1MDJ9LHsibmFtZSI6ImFkZGVkX3NuYXBzaG90X2lkIiwidHlwZSI6WyJudWxsIiwibG9uZyJdLCJkb2MiOiJTbmFwc2hvdCBJRCB0aGF0IGFkZGVkIHRoZSBtYW5pZmVzdCIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjo1MDN9LHsibmFtZSI6ImFkZGVkX2RhdGFfZmlsZXNfY291bnQiLCJ0eXBlIjpbIm51bGwiLCJpbnQiXSwiZG9jIjoiQWRkZWQgZW50cnkgY291bnQiLCJkZWZhdWx0IjpudWxsLCJmaWVsZC1pZCI6NTA0fSx7Im5hbWUiOiJleGlzdGluZ19kYXRhX2ZpbGVzX2NvdW50IiwidHlwZSI6WyJudWxsIiwiaW50Il0sImRvYyI6IkV4aXN0aW5nIGVudHJ5IGNvdW50IiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjUwNX0seyJuYW1lIjoiZGVsZXRlZF9kYXRhX2ZpbGVzX2NvdW50IiwidHlwZSI6WyJudWxsIiwiaW50Il0sImRvYyI6IkRlbGV0ZWQgZW50cnkgY291bnQiLCJkZWZhdWx0IjpudWxsLCJmaWVsZC1pZCI6NTA2fSx7Im5hbWUiOiJwYXJ0aXRpb25zIiwidHlwZSI6WyJudWxsIix7InR5cGUiOiJhcnJheSIsIml0ZW1zIjp7InR5cGUiOiJyZWNvcmQiLCJuYW1lIjoicjUwOCIsImZpZWxkcyI6W3sibmFtZSI6ImNvbnRhaW5zX251bGwiLCJ0eXBlIjoiYm9vbGVhbiIsImRvYyI6IlRydWUgaWYgYW55IGZpbGUgaGFzIGEgbnVsbCBwYXJ0aXRpb24gdmFsdWUiLCJmaWVsZC1pZCI6NTA5fSx7Im5hbWUiOiJjb250YWluc19uYW4iLCJ0eXBlIjpbIm51bGwiLCJib29sZWFuIl0sImRvYyI6IlRydWUgaWYgYW55IGZpbGUgaGFzIGEgbmFuIHBhcnRpdGlvbiB2YWx1ZSIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjo1MTh9LHsibmFtZSI6Imxvd2VyX2JvdW5kIiwidHlwZSI6WyJudWxsIiwiYnl0ZXMiXSwiZG9jIjoiUGFydGl0aW9uIGxvd2VyIGJvdW5kIGZvciBhbGwgZmlsZXMiLCJkZWZhdWx0IjpudWxsLCJmaWVsZC1pZCI6NTEwfSx7Im5hbWUiOiJ1cHBlcl9ib3VuZCIsInR5cGUiOlsibnVsbCIsImJ5dGVzIl0sImRvYyI6IlBhcnRpdGlvbiB1cHBlciBib3VuZCBmb3IgYWxsIGZpbGVzIiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjUxMX1dfSwiZWxlbWVudC1pZCI6NTA4fV0sImRvYyI6IlN1bW1hcnkgZm9yIGVhY2ggcGFydGl0aW9uIiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjUwN30seyJuYW1lIjoiYWRkZWRfcm93c19jb3VudCIsInR5cGUiOlsibnVsbCIsImxvbmciXSwiZG9jIjoiQWRkZWQgcm93cyBjb3VudCIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjo1MTJ9LHsibmFtZSI6ImV4aXN0aW5nX3Jvd3NfY291bnQiLCJ0eXBlIjpbIm51bGwiLCJsb25nIl0sImRvYyI6IkV4aXN0aW5nIHJvd3MgY291bnQiLCJkZWZhdWx0IjpudWxsLCJmaWVsZC1pZCI6NTEzfSx7Im5hbWUiOiJkZWxldGVkX3Jvd3NfY291bnQiLCJ0eXBlIjpbIm51bGwiLCJsb25nIl0sImRvYyI6IkRlbGV0ZWQgcm93cyBjb3VudCIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjo1MTR9XX0UYXZyby5jb2RlYw5kZWZsYXRlFnNuYXBzaG90LWlkJjU4MzA3ODA2ODY3MzM0ODMxNzQcZm9ybWF0LXZlcnNpb24CMRxpY2ViZXJnLnNjaGVtYbQaeyJ0eXBlIjoic3RydWN0Iiwic2NoZW1hLWlkIjowLCJmaWVsZHMiOlt7ImlkIjo1MDAsIm5hbWUiOiJtYW5pZmVzdF9wYXRoIiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJzdHJpbmciLCJkb2MiOiJMb2NhdGlvbiBVUkkgd2l0aCBGUyBzY2hlbWUifSx7ImlkIjo1MDEsIm5hbWUiOiJtYW5pZmVzdF9sZW5ndGgiLCJyZXF1aXJlZCI6dHJ1ZSwidHlwZSI6ImxvbmciLCJkb2MiOiJUb3RhbCBmaWxlIHNpemUgaW4gYnl0ZXMifSx7ImlkIjo1MDIsIm5hbWUiOiJwYXJ0aXRpb25fc3BlY19pZCIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjoiaW50IiwiZG9jIjoiU3BlYyBJRCB1c2VkIHRvIHdyaXRlIn0seyJpZCI6NTAzLCJuYW1lIjoiYWRkZWRfc25hcHNob3RfaWQiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOiJsb25nIiwiZG9jIjoiU25hcHNob3QgSUQgdGhhdCBhZGRlZCB0aGUgbWFuaWZlc3QifSx7ImlkIjo1MDQsIm5hbWUiOiJhZGRlZF9kYXRhX2ZpbGVzX2NvdW50IiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoiaW50IiwiZG9jIjoiQWRkZWQgZW50cnkgY291bnQifSx7ImlkIjo1MDUsIm5hbWUiOiJleGlzdGluZ19kYXRhX2ZpbGVzX2NvdW50IiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoiaW50IiwiZG9jIjoiRXhpc3RpbmcgZW50cnkgY291bnQifSx7ImlkIjo1MDYsIm5hbWUiOiJkZWxldGVkX2RhdGFfZmlsZXNfY291bnQiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOiJpbnQiLCJkb2MiOiJEZWxldGVkIGVudHJ5IGNvdW50In0seyJpZCI6NTA3LCJuYW1lIjoicGFydGl0aW9ucyIsInJlcXVpcmVkIjpmYWxzZSwidHlwZSI6eyJ0eXBlIjoibGlzdCIsImVsZW1lbnQtaWQiOjUwOCwiZWxlbWVudCI6eyJ0eXBlIjoic3RydWN0IiwiZmllbGRzIjpbeyJpZCI6NTA5LCJuYW1lIjoiY29udGFpbnNfbnVsbCIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjoiYm9vbGVhbiIsImRvYyI6IlRydWUgaWYgYW55IGZpbGUgaGFzIGEgbnVsbCBwYXJ0aXRpb24gdmFsdWUifSx7ImlkIjo1MTgsIm5hbWUiOiJjb250YWluc19uYW4iLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOiJib29sZWFuIiwiZG9jIjoiVHJ1ZSBpZiBhbnkgZmlsZSBoYXMgYSBuYW4gcGFydGl0aW9uIHZhbHVlIn0seyJpZCI6NTEwLCJuYW1lIjoibG93ZXJfYm91bmQiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOiJiaW5hcnkiLCJkb2MiOiJQYXJ0aXRpb24gbG93ZXIgYm91bmQgZm9yIGFsbCBmaWxlcyJ9LHsiaWQiOjUxMSwibmFtZSI6InVwcGVyX2JvdW5kIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoiYmluYXJ5IiwiZG9jIjoiUGFydGl0aW9uIHVwcGVyIGJvdW5kIGZvciBhbGwgZmlsZXMifV19LCJlbGVtZW50LXJlcXVpcmVkIjp0cnVlfSwiZG9jIjoiU3VtbWFyeSBmb3IgZWFjaCBwYXJ0aXRpb24ifSx7ImlkIjo1MTIsIm5hbWUiOiJhZGRlZF9yb3dzX2NvdW50IiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoibG9uZyIsImRvYyI6IkFkZGVkIHJvd3MgY291bnQifSx7ImlkIjo1MTMsIm5hbWUiOiJleGlzdGluZ19yb3dzX2NvdW50IiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoibG9uZyIsImRvYyI6IkV4aXN0aW5nIHJvd3MgY291bnQifSx7ImlkIjo1MTQsIm5hbWUiOiJkZWxldGVkX3Jvd3NfY291bnQiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOiJsb25nIiwiZG9jIjoiRGVsZXRlZCByb3dzIGNvdW50In1dfSRwYXJlbnQtc25hcHNob3QtaWQIbnVsbAAjsPlkS8eogm8bMYt4jmEOArYCNYxLCsIwFADb3CemqTGfs7h4vCQvKrRWmugRhIKXcCPewq0Lb+LOE4gFmcUsBubGxC6Qp3EDEQuKSAmPXRGFcoF/yXs85O1QYCSMWUI3BOzAUZI6kAarrAEVlQJE34IP6FMTlm6FKHoqOI919E7GFrmyjeMqGOK+MZpbqyQZcilGy/tmgadxOK8r9vrcH9N0eV9rxlg186x/+gIjsPlkS8eogm8bMYt4jmEO | base64 --decode > /iceberg_data/default/test_iceberg_snapshot_reads1_local_9ef16ce6_8487_4d44_aab2_bcabf0c395aa/metadata/snap-5830780686733483174-1-6db91d2a-4809-4c7e-b076-8841e7e9fdd8.avro] (cluster.py:121, run_and_check) 2025-05-23 21:10:56 [ 671 ] DEBUG : run container_id:rootteststorageiceberg-gw1-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p /iceberg_data/default/test_iceberg_snapshot_reads1_local_9ef16ce6_8487_4d44_aab2_bcabf0c395aa/metadata'] (cluster.py:2045, exec_in_container) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command:[docker exec rootteststorageiceberg-gw1-node1-1 bash -c mkdir -p /iceberg_data/default/test_iceberg_snapshot_reads1_local_9ef16ce6_8487_4d44_aab2_bcabf0c395aa/metadata] (cluster.py:121, run_and_check) 2025-05-23 21:10:56 [ 671 ] DEBUG : run container_id:rootteststorageiceberg-gw1-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname /iceberg_data/default/test_iceberg_snapshot_reads1_local_9ef16ce6_8487_4d44_aab2_bcabf0c395aa/metadata/version-hint.text) && echo MQ== | base64 --decode > /iceberg_data/default/test_iceberg_snapshot_reads1_local_9ef16ce6_8487_4d44_aab2_bcabf0c395aa/metadata/version-hint.text'] (cluster.py:2045, exec_in_container) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command:[docker exec rootteststorageiceberg-gw1-node1-1 bash -c mkdir -p $(dirname /iceberg_data/default/test_iceberg_snapshot_reads1_local_9ef16ce6_8487_4d44_aab2_bcabf0c395aa/metadata/version-hint.text) && echo MQ== | base64 --decode > /iceberg_data/default/test_iceberg_snapshot_reads1_local_9ef16ce6_8487_4d44_aab2_bcabf0c395aa/metadata/version-hint.text] (cluster.py:121, run_and_check) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: m d o841 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: m d o842 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: m d o843 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: m d o838 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: m d o840 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: m d o831 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: m d o848 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: m d o853 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: m d o861 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: m d o867 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: m d o874 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: m d o879 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: m d o846 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: m d o847 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: m d o849 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: m d o850 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: m d o851 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: m d o852 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: m d o854 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: m d o855 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: m d o856 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: m d o857 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: m d o858 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: m d o860 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: m d o862 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: m d o863 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: m d o864 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: m d o865 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: m d o866 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: m d o868 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: m d o869 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: m d o870 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: m d o871 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: m d o872 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: m d o873 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: m d o875 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: m d o876 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: m d o877 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: m d o878 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: m d o880 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: m d o881 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: m d o884 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: m d o885 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : run container_id:rootteststorageiceberg-gw1-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p /iceberg_data/default/test_iceberg_snapshot_reads1_local_9ef16ce6_8487_4d44_aab2_bcabf0c395aa/metadata'] (cluster.py:2045, exec_in_container) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command:[docker exec rootteststorageiceberg-gw1-node1-1 bash -c mkdir -p /iceberg_data/default/test_iceberg_snapshot_reads1_local_9ef16ce6_8487_4d44_aab2_bcabf0c395aa/metadata] (cluster.py:121, run_and_check) 2025-05-23 21:10:56 [ 671 ] DEBUG : run container_id:rootteststorageiceberg-gw1-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname /iceberg_data/default/test_iceberg_snapshot_reads1_local_9ef16ce6_8487_4d44_aab2_bcabf0c395aa/metadata/v1.metadata.json) && echo ewogICJmb3JtYXQtdmVyc2lvbiIgOiAxLAogICJ0YWJsZS11dWlkIiA6ICI1YzY0ZDU5MS0zNTZiLTRmZjQtOTA4MS0wZGViZjRmOThjNDAiLAogICJsb2NhdGlvbiIgOiAiL2ljZWJlcmdfZGF0YS9kZWZhdWx0L3Rlc3RfaWNlYmVyZ19zbmFwc2hvdF9yZWFkczFfbG9jYWxfOWVmMTZjZTZfODQ4N180ZDQ0X2FhYjJfYmNhYmYwYzM5NWFhIiwKICAibGFzdC11cGRhdGVkLW1zIiA6IDE3NDgwMzQ2NTYxMjcsCiAgImxhc3QtY29sdW1uLWlkIiA6IDIsCiAgInNjaGVtYSIgOiB7CiAgICAidHlwZSIgOiAic3RydWN0IiwKICAgICJzY2hlbWEtaWQiIDogMCwKICAgICJmaWVsZHMiIDogWyB7CiAgICAgICJpZCIgOiAxLAogICAgICAibmFtZSIgOiAiYSIsCiAgICAgICJyZXF1aXJlZCIgOiBmYWxzZSwKICAgICAgInR5cGUiIDogImxvbmciCiAgICB9LCB7CiAgICAgICJpZCIgOiAyLAogICAgICAibmFtZSIgOiAiYiIsCiAgICAgICJyZXF1aXJlZCIgOiBmYWxzZSwKICAgICAgInR5cGUiIDogInN0cmluZyIKICAgIH0gXQogIH0sCiAgImN1cnJlbnQtc2NoZW1hLWlkIiA6IDAsCiAgInNjaGVtYXMiIDogWyB7CiAgICAidHlwZSIgOiAic3RydWN0IiwKICAgICJzY2hlbWEtaWQiIDogMCwKICAgICJmaWVsZHMiIDogWyB7CiAgICAgICJpZCIgOiAxLAogICAgICAibmFtZSIgOiAiYSIsCiAgICAgICJyZXF1aXJlZCIgOiBmYWxzZSwKICAgICAgInR5cGUiIDogImxvbmciCiAgICB9LCB7CiAgICAgICJpZCIgOiAyLAogICAgICAibmFtZSIgOiAiYiIsCiAgICAgICJyZXF1aXJlZCIgOiBmYWxzZSwKICAgICAgInR5cGUiIDogInN0cmluZyIKICAgIH0gXQogIH0gXSwKICAicGFydGl0aW9uLXNwZWMiIDogWyBdLAogICJkZWZhdWx0LXNwZWMtaWQiIDogMCwKICAicGFydGl0aW9uLXNwZWNzIiA6IFsgewogICAgInNwZWMtaWQiIDogMCwKICAgICJmaWVsZHMiIDogWyBdCiAgfSBdLAogICJsYXN0LXBhcnRpdGlvbi1pZCIgOiA5OTksCiAgImRlZmF1bHQtc29ydC1vcmRlci1pZCIgOiAwLAogICJzb3J0LW9yZGVycyIgOiBbIHsKICAgICJvcmRlci1pZCIgOiAwLAogICAgImZpZWxkcyIgOiBbIF0KICB9IF0sCiAgInByb3BlcnRpZXMiIDogewogICAgIm93bmVyIiA6ICJyb290IgogIH0sCiAgImN1cnJlbnQtc25hcHNob3QtaWQiIDogNTgzMDc4MDY4NjczMzQ4MzE3NCwKICAicmVmcyIgOiB7CiAgICAibWFpbiIgOiB7CiAgICAgICJzbmFwc2hvdC1pZCIgOiA1ODMwNzgwNjg2NzMzNDgzMTc0LAogICAgICAidHlwZSIgOiAiYnJhbmNoIgogICAgfQogIH0sCiAgInNuYXBzaG90cyIgOiBbIHsKICAgICJzbmFwc2hvdC1pZCIgOiA1ODMwNzgwNjg2NzMzNDgzMTc0LAogICAgInRpbWVzdGFtcC1tcyIgOiAxNzQ4MDM0NjU2MTI3LAogICAgInN1bW1hcnkiIDogewogICAgICAib3BlcmF0aW9uIiA6ICJhcHBlbmQiLAogICAgICAic3BhcmsuYXBwLmlkIiA6ICJsb2NhbC0xNzQ4MDM0NjM2NDMyIiwKICAgICAgImFkZGVkLWRhdGEtZmlsZXMiIDogIjEiLAogICAgICAiYWRkZWQtcmVjb3JkcyIgOiAiMTAwIiwKICAgICAgImFkZGVkLWZpbGVzLXNpemUiIDogIjk2NyIsCiAgICAgICJjaGFuZ2VkLXBhcnRpdGlvbi1jb3VudCIgOiAiMSIsCiAgICAgICJ0b3RhbC1yZWNvcmRzIiA6ICIxMDAiLAogICAgICAidG90YWwtZmlsZXMtc2l6ZSIgOiAiOTY3IiwKICAgICAgInRvdGFsLWRhdGEtZmlsZXMiIDogIjEiLAogICAgICAidG90YWwtZGVsZXRlLWZpbGVzIiA6ICIwIiwKICAgICAgInRvdGFsLXBvc2l0aW9uLWRlbGV0ZXMiIDogIjAiLAogICAgICAidG90YWwtZXF1YWxpdHktZGVsZXRlcyIgOiAiMCIKICAgIH0sCiAgICAibWFuaWZlc3QtbGlzdCIgOiAiL2ljZWJlcmdfZGF0YS9kZWZhdWx0L3Rlc3RfaWNlYmVyZ19zbmFwc2hvdF9yZWFkczFfbG9jYWxfOWVmMTZjZTZfODQ4N180ZDQ0X2FhYjJfYmNhYmYwYzM5NWFhL21ldGFkYXRhL3NuYXAtNTgzMDc4MDY4NjczMzQ4MzE3NC0xLTZkYjkxZDJhLTQ4MDktNGM3ZS1iMDc2LTg4NDFlN2U5ZmRkOC5hdnJvIiwKICAgICJzY2hlbWEtaWQiIDogMAogIH0gXSwKICAic3RhdGlzdGljcyIgOiBbIF0sCiAgInNuYXBzaG90LWxvZyIgOiBbIHsKICAgICJ0aW1lc3RhbXAtbXMiIDogMTc0ODAzNDY1NjEyNywKICAgICJzbmFwc2hvdC1pZCIgOiA1ODMwNzgwNjg2NzMzNDgzMTc0CiAgfSBdLAogICJtZXRhZGF0YS1sb2ciIDogWyBdCn0= | base64 --decode > /iceberg_data/default/test_iceberg_snapshot_reads1_local_9ef16ce6_8487_4d44_aab2_bcabf0c395aa/metadata/v1.metadata.json'] (cluster.py:2045, exec_in_container) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command:[docker exec rootteststorageiceberg-gw1-node1-1 bash -c mkdir -p $(dirname /iceberg_data/default/test_iceberg_snapshot_reads1_local_9ef16ce6_8487_4d44_aab2_bcabf0c395aa/metadata/v1.metadata.json) && echo ewogICJmb3JtYXQtdmVyc2lvbiIgOiAxLAogICJ0YWJsZS11dWlkIiA6ICI1YzY0ZDU5MS0zNTZiLTRmZjQtOTA4MS0wZGViZjRmOThjNDAiLAogICJsb2NhdGlvbiIgOiAiL2ljZWJlcmdfZGF0YS9kZWZhdWx0L3Rlc3RfaWNlYmVyZ19zbmFwc2hvdF9yZWFkczFfbG9jYWxfOWVmMTZjZTZfODQ4N180ZDQ0X2FhYjJfYmNhYmYwYzM5NWFhIiwKICAibGFzdC11cGRhdGVkLW1zIiA6IDE3NDgwMzQ2NTYxMjcsCiAgImxhc3QtY29sdW1uLWlkIiA6IDIsCiAgInNjaGVtYSIgOiB7CiAgICAidHlwZSIgOiAic3RydWN0IiwKICAgICJzY2hlbWEtaWQiIDogMCwKICAgICJmaWVsZHMiIDogWyB7CiAgICAgICJpZCIgOiAxLAogICAgICAibmFtZSIgOiAiYSIsCiAgICAgICJyZXF1aXJlZCIgOiBmYWxzZSwKICAgICAgInR5cGUiIDogImxvbmciCiAgICB9LCB7CiAgICAgICJpZCIgOiAyLAogICAgICAibmFtZSIgOiAiYiIsCiAgICAgICJyZXF1aXJlZCIgOiBmYWxzZSwKICAgICAgInR5cGUiIDogInN0cmluZyIKICAgIH0gXQogIH0sCiAgImN1cnJlbnQtc2NoZW1hLWlkIiA6IDAsCiAgInNjaGVtYXMiIDogWyB7CiAgICAidHlwZSIgOiAic3RydWN0IiwKICAgICJzY2hlbWEtaWQiIDogMCwKICAgICJmaWVsZHMiIDogWyB7CiAgICAgICJpZCIgOiAxLAogICAgICAibmFtZSIgOiAiYSIsCiAgICAgICJyZXF1aXJlZCIgOiBmYWxzZSwKICAgICAgInR5cGUiIDogImxvbmciCiAgICB9LCB7CiAgICAgICJpZCIgOiAyLAogICAgICAibmFtZSIgOiAiYiIsCiAgICAgICJyZXF1aXJlZCIgOiBmYWxzZSwKICAgICAgInR5cGUiIDogInN0cmluZyIKICAgIH0gXQogIH0gXSwKICAicGFydGl0aW9uLXNwZWMiIDogWyBdLAogICJkZWZhdWx0LXNwZWMtaWQiIDogMCwKICAicGFydGl0aW9uLXNwZWNzIiA6IFsgewogICAgInNwZWMtaWQiIDogMCwKICAgICJmaWVsZHMiIDogWyBdCiAgfSBdLAogICJsYXN0LXBhcnRpdGlvbi1pZCIgOiA5OTksCiAgImRlZmF1bHQtc29ydC1vcmRlci1pZCIgOiAwLAogICJzb3J0LW9yZGVycyIgOiBbIHsKICAgICJvcmRlci1pZCIgOiAwLAogICAgImZpZWxkcyIgOiBbIF0KICB9IF0sCiAgInByb3BlcnRpZXMiIDogewogICAgIm93bmVyIiA6ICJyb290IgogIH0sCiAgImN1cnJlbnQtc25hcHNob3QtaWQiIDogNTgzMDc4MDY4NjczMzQ4MzE3NCwKICAicmVmcyIgOiB7CiAgICAibWFpbiIgOiB7CiAgICAgICJzbmFwc2hvdC1pZCIgOiA1ODMwNzgwNjg2NzMzNDgzMTc0LAogICAgICAidHlwZSIgOiAiYnJhbmNoIgogICAgfQogIH0sCiAgInNuYXBzaG90cyIgOiBbIHsKICAgICJzbmFwc2hvdC1pZCIgOiA1ODMwNzgwNjg2NzMzNDgzMTc0LAogICAgInRpbWVzdGFtcC1tcyIgOiAxNzQ4MDM0NjU2MTI3LAogICAgInN1bW1hcnkiIDogewogICAgICAib3BlcmF0aW9uIiA6ICJhcHBlbmQiLAogICAgICAic3BhcmsuYXBwLmlkIiA6ICJsb2NhbC0xNzQ4MDM0NjM2NDMyIiwKICAgICAgImFkZGVkLWRhdGEtZmlsZXMiIDogIjEiLAogICAgICAiYWRkZWQtcmVjb3JkcyIgOiAiMTAwIiwKICAgICAgImFkZGVkLWZpbGVzLXNpemUiIDogIjk2NyIsCiAgICAgICJjaGFuZ2VkLXBhcnRpdGlvbi1jb3VudCIgOiAiMSIsCiAgICAgICJ0b3RhbC1yZWNvcmRzIiA6ICIxMDAiLAogICAgICAidG90YWwtZmlsZXMtc2l6ZSIgOiAiOTY3IiwKICAgICAgInRvdGFsLWRhdGEtZmlsZXMiIDogIjEiLAogICAgICAidG90YWwtZGVsZXRlLWZpbGVzIiA6ICIwIiwKICAgICAgInRvdGFsLXBvc2l0aW9uLWRlbGV0ZXMiIDogIjAiLAogICAgICAidG90YWwtZXF1YWxpdHktZGVsZXRlcyIgOiAiMCIKICAgIH0sCiAgICAibWFuaWZlc3QtbGlzdCIgOiAiL2ljZWJlcmdfZGF0YS9kZWZhdWx0L3Rlc3RfaWNlYmVyZ19zbmFwc2hvdF9yZWFkczFfbG9jYWxfOWVmMTZjZTZfODQ4N180ZDQ0X2FhYjJfYmNhYmYwYzM5NWFhL21ldGFkYXRhL3NuYXAtNTgzMDc4MDY4NjczMzQ4MzE3NC0xLTZkYjkxZDJhLTQ4MDktNGM3ZS1iMDc2LTg4NDFlN2U5ZmRkOC5hdnJvIiwKICAgICJzY2hlbWEtaWQiIDogMAogIH0gXSwKICAic3RhdGlzdGljcyIgOiBbIF0sCiAgInNuYXBzaG90LWxvZyIgOiBbIHsKICAgICJ0aW1lc3RhbXAtbXMiIDogMTc0ODAzNDY1NjEyNywKICAgICJzbmFwc2hvdC1pZCIgOiA1ODMwNzgwNjg2NzMzNDgzMTc0CiAgfSBdLAogICJtZXRhZGF0YS1sb2ciIDogWyBdCn0= | base64 --decode > /iceberg_data/default/test_iceberg_snapshot_reads1_local_9ef16ce6_8487_4d44_aab2_bcabf0c395aa/metadata/v1.metadata.json] (cluster.py:121, run_and_check) 2025-05-23 21:10:56 [ 671 ] DEBUG : Executing query DROP TABLE IF EXISTS test_iceberg_snapshot_reads1_local_9ef16ce6_8487_4d44_aab2_bcabf0c395aa SYNC on node1 (cluster.py:3570, query) 2025-05-23 21:10:56 [ 671 ] DEBUG : Executing query DROP TABLE IF EXISTS test_iceberg_snapshot_reads1_local_9ef16ce6_8487_4d44_aab2_bcabf0c395aa; CREATE TABLE test_iceberg_snapshot_reads1_local_9ef16ce6_8487_4d44_aab2_bcabf0c395aa ENGINE=IcebergLocal(local, path = '/iceberg_data/default/test_iceberg_snapshot_reads1_local_9ef16ce6_8487_4d44_aab2_bcabf0c395aa/', format=Parquet) on node1 (cluster.py:3570, query) 2025-05-23 21:10:56 [ 671 ] DEBUG : Executing query SELECT count() FROM test_iceberg_snapshot_reads1_local_9ef16ce6_8487_4d44_aab2_bcabf0c395aa on node1 (cluster.py:3570, query) _____________________ test_iceberg_snapshot_reads[local-2] _____________________ [gw1] linux -- Python 3.10.12 /usr/bin/python3 started_cluster = format_version = '2', storage_type = 'local' @pytest.mark.parametrize("format_version", ["1", "2"]) @pytest.mark.parametrize("storage_type", ["s3", "azure", "local"]) def test_iceberg_snapshot_reads(started_cluster, format_version, storage_type): instance = started_cluster.instances["node1"] spark = started_cluster.spark_session TABLE_NAME = ( "test_iceberg_snapshot_reads" + format_version + "_" + storage_type + "_" + get_uuid_str() ) write_iceberg_from_df( spark, generate_data(spark, 0, 100), TABLE_NAME, mode="overwrite", format_version=format_version, ) default_upload_directory( started_cluster, storage_type, f"/iceberg_data/default/{TABLE_NAME}/", "", ) create_iceberg_table(storage_type, instance, TABLE_NAME, started_cluster) assert int(instance.query(f"SELECT count() FROM {TABLE_NAME}")) == 100 snapshot1_timestamp = datetime.now(timezone.utc) snapshot1_id = get_last_snapshot(f"/iceberg_data/default/{TABLE_NAME}/") > time.sleep(0.1) E NameError: name 'time' is not defined test_storage_iceberg/test.py:2568: NameError ----------------------------- Captured stdout call ----------------------------- 25/05/23 21:10:56 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:56 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:56 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:56 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:56 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:56 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. {} {} {} {'format-version': 2, 'table-uuid': 'fc59885e-6f80-487f-86c1-3f59fec121c8', 'location': '/iceberg_data/default/test_iceberg_snapshot_reads2_local_7c2826c0_a455_4750_8e24_1fcf299f77cb', 'last-sequence-number': 1, 'last-updated-ms': 1748034657033, 'last-column-id': 2, 'current-schema-id': 0, 'schemas': [{'type': 'struct', 'schema-id': 0, 'fields': [{'id': 1, 'name': 'a', 'required': False, 'type': 'long'}, {'id': 2, 'name': 'b', 'required': False, 'type': 'string'}]}], 'default-spec-id': 0, 'partition-specs': [{'spec-id': 0, 'fields': []}], 'last-partition-id': 999, 'default-sort-order-id': 0, 'sort-orders': [{'order-id': 0, 'fields': []}], 'properties': {'owner': 'root'}, 'current-snapshot-id': 5885886435165266578, 'refs': {'main': {'snapshot-id': 5885886435165266578, 'type': 'branch'}}, 'snapshots': [{'sequence-number': 1, 'snapshot-id': 5885886435165266578, 'timestamp-ms': 1748034657033, 'summary': {'operation': 'append', 'spark.app.id': 'local-1748034636432', 'added-data-files': '1', 'added-records': '100', 'added-files-size': '967', 'changed-partition-count': '1', 'total-records': '100', 'total-files-size': '967', 'total-data-files': '1', 'total-delete-files': '0', 'total-position-deletes': '0', 'total-equality-deletes': '0'}, 'manifest-list': '/iceberg_data/default/test_iceberg_snapshot_reads2_local_7c2826c0_a455_4750_8e24_1fcf299f77cb/metadata/snap-5885886435165266578-1-c010cab2-cd10-4e06-9d5d-642a92a59840.avro', 'schema-id': 0}], 'statistics': [], 'snapshot-log': [{'timestamp-ms': 1748034657033, 'snapshot-id': 5885886435165266578}], 'metadata-log': []} ------------------------------ Captured log call ------------------------------- 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yro886 (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: c o886 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: c o61 range i0 i100 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yro887 (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !ylo888 (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: c o888 add sa e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro888 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yro889 (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: c o887 toDF ro889 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yro890 (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yro891 (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: c o891 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: c o61 range i1 i101 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yro892 (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !ylo893 (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: c o893 add sb e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro893 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yro894 (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: c o892 toDF ro894 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yro895 (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: c o895 apply sb e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yro896 (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yro897 (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: c o897 isDefined e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yro898 (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: c o898 get e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yro899 (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yro900 (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yao901 (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: c o900 applyModifiableSettings ro899 ro901 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: c o61 parseDataType s"string" e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yro902 (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: c o896 cast ro902 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yro903 (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: c o895 withColumn sb ro903 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yro904 (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yro905 (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yro906 (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !ylo907 (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: c o907 add ro906 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro907 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yro908 (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro908 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yro909 (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: c o905 over ro909 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yro910 (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: c o890 withColumn srow_index ro910 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yro911 (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yro912 (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yro913 (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !ylo914 (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: c o914 add ro913 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro914 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yro915 (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro915 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yro916 (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: c o912 over ro916 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yro917 (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: c o904 withColumn srow_index ro917 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yro918 (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !ylo919 (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: c o919 add srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro919 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yro920 (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: c o911 join ro918 ro920 sinner e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yro921 (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: c o921 drop srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yro922 (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: c o922 writeTo stest_iceberg_snapshot_reads2_local_7c2826c0_a455_4750_8e24_1fcf299f77cb e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yro923 (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: c o923 tableProperty sformat-version s2 e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yro924 (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: c o923 using siceberg e (clientserver.py:501, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Answer received: !yro925 (clientserver.py:512, send_command) 2025-05-23 21:10:56 [ 671 ] DEBUG : Command to send: c o923 create e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : run container_id:rootteststorageiceberg-gw1-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p /iceberg_data/default/test_iceberg_snapshot_reads2_local_7c2826c0_a455_4750_8e24_1fcf299f77cb/data'] (cluster.py:2045, exec_in_container) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command:[docker exec rootteststorageiceberg-gw1-node1-1 bash -c mkdir -p /iceberg_data/default/test_iceberg_snapshot_reads2_local_7c2826c0_a455_4750_8e24_1fcf299f77cb/data] (cluster.py:121, run_and_check) 2025-05-23 21:10:57 [ 671 ] DEBUG : run container_id:rootteststorageiceberg-gw1-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname /iceberg_data/default/test_iceberg_snapshot_reads2_local_7c2826c0_a455_4750_8e24_1fcf299f77cb/data/00000-43-d96df022-041d-42a5-855c-a7d680d833ff-00001.parquet) && echo UEFSMRUAFcAMFfYCFb3z1JUGHBXIARUAFQgVCAAAH4sIAAAAAAAAAC3F1yICAAAAwJBZIVskK7OyM0OK7IzKjvL//+DB3csFAv9a3Oo2B93uDne6y93ucchhR9zrPvc76gEPesjDHvGoxzzumCc86binnPC0ZzzrOc876QUvesnLXvGqU0474zWve8Ob3vK2d5z1rve87wMf+sg5H/vEp877zAUXfe4Ll3zpK1/7xre+873LfvCjn/zsiquu+cWvfvO7P/zpL9f97R833PSv/wACwudxIAMAABUAFaAJFeoCFY28v7gJHBXIARUAFQgVCAAAH4sIAAAAAAAAAB3SsYFCMQxEwQ/XEFiyJPffGOdJXrST7et5nu/rP+smbvJm39RN38zNed/xR7+6NDR1a2nrKLvYxS52sYtd7GIXu9jFBhtssMEGG2ywwQYbbLLJJptssskmm2yyyW52s5vd7GY3u9nNbnazxRZbbLHFFltsscUW22yzzTbbbLPNNttss8MOO+ywww477LDDDnvYwx72sIc97GEPe9hz/nzj8wPU24atUAIAABkRAhkYCAAAAAAAAAAAGRgIYwAAAAAAAAAVAhkWAAAZEQIZGAExGRgCOTkVAhkWAAAZHBYIFaoDFgAAABkcFrIDFZ4DFgAAABUCGTxIBXRhYmxlFQQAFQQlABgBYVUCABUMJQAYAWIlADUEHBwAAAAWyAEZHBksJggcFQQZJQAIGRgBYRUEFsgBFvQMFqoDJgg8GAhjAAAAAAAAABgIAAAAAAAAAAAWACgIYwAAAAAAAAAYCAAAAAAAAAAAABkcFQAVABUCAAAWsgcVFhbQBhU+ACayAxwVDBklAAgZGAFiFQQWyAEW1AkWngMmsgM8NgAoAjk5GAExABkcFQAVABUCAAAWyAcVGBaOBxUkABbIFhbIASYIFsgGFAAAGRwYDmljZWJlcmcuc2NoZW1hGJABeyJ0eXBlIjoic3RydWN0Iiwic2NoZW1hLWlkIjowLCJmaWVsZHMiOlt7ImlkIjoxLCJuYW1lIjoiYSIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjoibG9uZyJ9LHsiaWQiOjIsIm5hbWUiOiJiIiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJzdHJpbmcifV19ABhKcGFycXVldC1tciB2ZXJzaW9uIDEuMTIuMyAoYnVpbGQgZjhkY2VkMTgyYzRjMWZiZGVjNmNjYjMxODU1MzdiNWEwMWU2ZWQ2YikZLBwAABwAAADPAQAAUEFSMQ== | base64 --decode > /iceberg_data/default/test_iceberg_snapshot_reads2_local_7c2826c0_a455_4750_8e24_1fcf299f77cb/data/00000-43-d96df022-041d-42a5-855c-a7d680d833ff-00001.parquet'] (cluster.py:2045, exec_in_container) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command:[docker exec rootteststorageiceberg-gw1-node1-1 bash -c mkdir -p $(dirname /iceberg_data/default/test_iceberg_snapshot_reads2_local_7c2826c0_a455_4750_8e24_1fcf299f77cb/data/00000-43-d96df022-041d-42a5-855c-a7d680d833ff-00001.parquet) && echo UEFSMRUAFcAMFfYCFb3z1JUGHBXIARUAFQgVCAAAH4sIAAAAAAAAAC3F1yICAAAAwJBZIVskK7OyM0OK7IzKjvL//+DB3csFAv9a3Oo2B93uDne6y93ucchhR9zrPvc76gEPesjDHvGoxzzumCc86binnPC0ZzzrOc876QUvesnLXvGqU0474zWve8Ob3vK2d5z1rve87wMf+sg5H/vEp877zAUXfe4Ll3zpK1/7xre+873LfvCjn/zsiquu+cWvfvO7P/zpL9f97R833PSv/wACwudxIAMAABUAFaAJFeoCFY28v7gJHBXIARUAFQgVCAAAH4sIAAAAAAAAAB3SsYFCMQxEwQ/XEFiyJPffGOdJXrST7et5nu/rP+smbvJm39RN38zNed/xR7+6NDR1a2nrKLvYxS52sYtd7GIXu9jFBhtssMEGG2ywwQYbbLLJJptssskmm2yyyW52s5vd7GY3u9nNbnazxRZbbLHFFltsscUW22yzzTbbbLPNNttss8MOO+ywww477LDDDnvYwx72sIc97GEPe9hz/nzj8wPU24atUAIAABkRAhkYCAAAAAAAAAAAGRgIYwAAAAAAAAAVAhkWAAAZEQIZGAExGRgCOTkVAhkWAAAZHBYIFaoDFgAAABkcFrIDFZ4DFgAAABUCGTxIBXRhYmxlFQQAFQQlABgBYVUCABUMJQAYAWIlADUEHBwAAAAWyAEZHBksJggcFQQZJQAIGRgBYRUEFsgBFvQMFqoDJgg8GAhjAAAAAAAAABgIAAAAAAAAAAAWACgIYwAAAAAAAAAYCAAAAAAAAAAAABkcFQAVABUCAAAWsgcVFhbQBhU+ACayAxwVDBklAAgZGAFiFQQWyAEW1AkWngMmsgM8NgAoAjk5GAExABkcFQAVABUCAAAWyAcVGBaOBxUkABbIFhbIASYIFsgGFAAAGRwYDmljZWJlcmcuc2NoZW1hGJABeyJ0eXBlIjoic3RydWN0Iiwic2NoZW1hLWlkIjowLCJmaWVsZHMiOlt7ImlkIjoxLCJuYW1lIjoiYSIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjoibG9uZyJ9LHsiaWQiOjIsIm5hbWUiOiJiIiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJzdHJpbmcifV19ABhKcGFycXVldC1tciB2ZXJzaW9uIDEuMTIuMyAoYnVpbGQgZjhkY2VkMTgyYzRjMWZiZGVjNmNjYjMxODU1MzdiNWEwMWU2ZWQ2YikZLBwAABwAAADPAQAAUEFSMQ== | base64 --decode > /iceberg_data/default/test_iceberg_snapshot_reads2_local_7c2826c0_a455_4750_8e24_1fcf299f77cb/data/00000-43-d96df022-041d-42a5-855c-a7d680d833ff-00001.parquet] (cluster.py:121, run_and_check) 2025-05-23 21:10:57 [ 671 ] DEBUG : run container_id:rootteststorageiceberg-gw1-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p /iceberg_data/default/test_iceberg_snapshot_reads2_local_7c2826c0_a455_4750_8e24_1fcf299f77cb/metadata'] (cluster.py:2045, exec_in_container) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command:[docker exec rootteststorageiceberg-gw1-node1-1 bash -c mkdir -p /iceberg_data/default/test_iceberg_snapshot_reads2_local_7c2826c0_a455_4750_8e24_1fcf299f77cb/metadata] (cluster.py:121, run_and_check) 2025-05-23 21:10:57 [ 671 ] DEBUG : run container_id:rootteststorageiceberg-gw1-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname /iceberg_data/default/test_iceberg_snapshot_reads2_local_7c2826c0_a455_4750_8e24_1fcf299f77cb/metadata/snap-5885886435165266578-1-c010cab2-cd10-4e06-9d5d-642a92a59840.avro) && echo T2JqAQ4WYXZyby5zY2hlbWGeHnsidHlwZSI6InJlY29yZCIsIm5hbWUiOiJtYW5pZmVzdF9maWxlIiwiZmllbGRzIjpbeyJuYW1lIjoibWFuaWZlc3RfcGF0aCIsInR5cGUiOiJzdHJpbmciLCJkb2MiOiJMb2NhdGlvbiBVUkkgd2l0aCBGUyBzY2hlbWUiLCJmaWVsZC1pZCI6NTAwfSx7Im5hbWUiOiJtYW5pZmVzdF9sZW5ndGgiLCJ0eXBlIjoibG9uZyIsImRvYyI6IlRvdGFsIGZpbGUgc2l6ZSBpbiBieXRlcyIsImZpZWxkLWlkIjo1MDF9LHsibmFtZSI6InBhcnRpdGlvbl9zcGVjX2lkIiwidHlwZSI6ImludCIsImRvYyI6IlNwZWMgSUQgdXNlZCB0byB3cml0ZSIsImZpZWxkLWlkIjo1MDJ9LHsibmFtZSI6ImNvbnRlbnQiLCJ0eXBlIjoiaW50IiwiZG9jIjoiQ29udGVudHMgb2YgdGhlIG1hbmlmZXN0OiAwPWRhdGEsIDE9ZGVsZXRlcyIsImZpZWxkLWlkIjo1MTd9LHsibmFtZSI6InNlcXVlbmNlX251bWJlciIsInR5cGUiOiJsb25nIiwiZG9jIjoiU2VxdWVuY2UgbnVtYmVyIHdoZW4gdGhlIG1hbmlmZXN0IHdhcyBhZGRlZCIsImZpZWxkLWlkIjo1MTV9LHsibmFtZSI6Im1pbl9zZXF1ZW5jZV9udW1iZXIiLCJ0eXBlIjoibG9uZyIsImRvYyI6Ikxvd2VzdCBzZXF1ZW5jZSBudW1iZXIgaW4gdGhlIG1hbmlmZXN0IiwiZmllbGQtaWQiOjUxNn0seyJuYW1lIjoiYWRkZWRfc25hcHNob3RfaWQiLCJ0eXBlIjoibG9uZyIsImRvYyI6IlNuYXBzaG90IElEIHRoYXQgYWRkZWQgdGhlIG1hbmlmZXN0IiwiZmllbGQtaWQiOjUwM30seyJuYW1lIjoiYWRkZWRfZGF0YV9maWxlc19jb3VudCIsInR5cGUiOiJpbnQiLCJkb2MiOiJBZGRlZCBlbnRyeSBjb3VudCIsImZpZWxkLWlkIjo1MDR9LHsibmFtZSI6ImV4aXN0aW5nX2RhdGFfZmlsZXNfY291bnQiLCJ0eXBlIjoiaW50IiwiZG9jIjoiRXhpc3RpbmcgZW50cnkgY291bnQiLCJmaWVsZC1pZCI6NTA1fSx7Im5hbWUiOiJkZWxldGVkX2RhdGFfZmlsZXNfY291bnQiLCJ0eXBlIjoiaW50IiwiZG9jIjoiRGVsZXRlZCBlbnRyeSBjb3VudCIsImZpZWxkLWlkIjo1MDZ9LHsibmFtZSI6ImFkZGVkX3Jvd3NfY291bnQiLCJ0eXBlIjoibG9uZyIsImRvYyI6IkFkZGVkIHJvd3MgY291bnQiLCJmaWVsZC1pZCI6NTEyfSx7Im5hbWUiOiJleGlzdGluZ19yb3dzX2NvdW50IiwidHlwZSI6ImxvbmciLCJkb2MiOiJFeGlzdGluZyByb3dzIGNvdW50IiwiZmllbGQtaWQiOjUxM30seyJuYW1lIjoiZGVsZXRlZF9yb3dzX2NvdW50IiwidHlwZSI6ImxvbmciLCJkb2MiOiJEZWxldGVkIHJvd3MgY291bnQiLCJmaWVsZC1pZCI6NTE0fSx7Im5hbWUiOiJwYXJ0aXRpb25zIiwidHlwZSI6WyJudWxsIix7InR5cGUiOiJhcnJheSIsIml0ZW1zIjp7InR5cGUiOiJyZWNvcmQiLCJuYW1lIjoicjUwOCIsImZpZWxkcyI6W3sibmFtZSI6ImNvbnRhaW5zX251bGwiLCJ0eXBlIjoiYm9vbGVhbiIsImRvYyI6IlRydWUgaWYgYW55IGZpbGUgaGFzIGEgbnVsbCBwYXJ0aXRpb24gdmFsdWUiLCJmaWVsZC1pZCI6NTA5fSx7Im5hbWUiOiJjb250YWluc19uYW4iLCJ0eXBlIjpbIm51bGwiLCJib29sZWFuIl0sImRvYyI6IlRydWUgaWYgYW55IGZpbGUgaGFzIGEgbmFuIHBhcnRpdGlvbiB2YWx1ZSIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjo1MTh9LHsibmFtZSI6Imxvd2VyX2JvdW5kIiwidHlwZSI6WyJudWxsIiwiYnl0ZXMiXSwiZG9jIjoiUGFydGl0aW9uIGxvd2VyIGJvdW5kIGZvciBhbGwgZmlsZXMiLCJkZWZhdWx0IjpudWxsLCJmaWVsZC1pZCI6NTEwfSx7Im5hbWUiOiJ1cHBlcl9ib3VuZCIsInR5cGUiOlsibnVsbCIsImJ5dGVzIl0sImRvYyI6IlBhcnRpdGlvbiB1cHBlciBib3VuZCBmb3IgYWxsIGZpbGVzIiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjUxMX1dfSwiZWxlbWVudC1pZCI6NTA4fV0sImRvYyI6IlN1bW1hcnkgZm9yIGVhY2ggcGFydGl0aW9uIiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjUwN31dfRRhdnJvLmNvZGVjDmRlZmxhdGUWc25hcHNob3QtaWQmNTg4NTg4NjQzNTE2NTI2NjU3OBxmb3JtYXQtdmVyc2lvbgIyHnNlcXVlbmNlLW51bWJlcgIxHGljZWJlcmcuc2NoZW1h1h97InR5cGUiOiJzdHJ1Y3QiLCJzY2hlbWEtaWQiOjAsImZpZWxkcyI6W3siaWQiOjUwMCwibmFtZSI6Im1hbmlmZXN0X3BhdGgiLCJyZXF1aXJlZCI6dHJ1ZSwidHlwZSI6InN0cmluZyIsImRvYyI6IkxvY2F0aW9uIFVSSSB3aXRoIEZTIHNjaGVtZSJ9LHsiaWQiOjUwMSwibmFtZSI6Im1hbmlmZXN0X2xlbmd0aCIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjoibG9uZyIsImRvYyI6IlRvdGFsIGZpbGUgc2l6ZSBpbiBieXRlcyJ9LHsiaWQiOjUwMiwibmFtZSI6InBhcnRpdGlvbl9zcGVjX2lkIiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJpbnQiLCJkb2MiOiJTcGVjIElEIHVzZWQgdG8gd3JpdGUifSx7ImlkIjo1MTcsIm5hbWUiOiJjb250ZW50IiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJpbnQiLCJkb2MiOiJDb250ZW50cyBvZiB0aGUgbWFuaWZlc3Q6IDA9ZGF0YSwgMT1kZWxldGVzIn0seyJpZCI6NTE1LCJuYW1lIjoic2VxdWVuY2VfbnVtYmVyIiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJsb25nIiwiZG9jIjoiU2VxdWVuY2UgbnVtYmVyIHdoZW4gdGhlIG1hbmlmZXN0IHdhcyBhZGRlZCJ9LHsiaWQiOjUxNiwibmFtZSI6Im1pbl9zZXF1ZW5jZV9udW1iZXIiLCJyZXF1aXJlZCI6dHJ1ZSwidHlwZSI6ImxvbmciLCJkb2MiOiJMb3dlc3Qgc2VxdWVuY2UgbnVtYmVyIGluIHRoZSBtYW5pZmVzdCJ9LHsiaWQiOjUwMywibmFtZSI6ImFkZGVkX3NuYXBzaG90X2lkIiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJsb25nIiwiZG9jIjoiU25hcHNob3QgSUQgdGhhdCBhZGRlZCB0aGUgbWFuaWZlc3QifSx7ImlkIjo1MDQsIm5hbWUiOiJhZGRlZF9kYXRhX2ZpbGVzX2NvdW50IiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJpbnQiLCJkb2MiOiJBZGRlZCBlbnRyeSBjb3VudCJ9LHsiaWQiOjUwNSwibmFtZSI6ImV4aXN0aW5nX2RhdGFfZmlsZXNfY291bnQiLCJyZXF1aXJlZCI6dHJ1ZSwidHlwZSI6ImludCIsImRvYyI6IkV4aXN0aW5nIGVudHJ5IGNvdW50In0seyJpZCI6NTA2LCJuYW1lIjoiZGVsZXRlZF9kYXRhX2ZpbGVzX2NvdW50IiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJpbnQiLCJkb2MiOiJEZWxldGVkIGVudHJ5IGNvdW50In0seyJpZCI6NTEyLCJuYW1lIjoiYWRkZWRfcm93c19jb3VudCIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjoibG9uZyIsImRvYyI6IkFkZGVkIHJvd3MgY291bnQifSx7ImlkIjo1MTMsIm5hbWUiOiJleGlzdGluZ19yb3dzX2NvdW50IiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJsb25nIiwiZG9jIjoiRXhpc3Rpbmcgcm93cyBjb3VudCJ9LHsiaWQiOjUxNCwibmFtZSI6ImRlbGV0ZWRfcm93c19jb3VudCIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjoibG9uZyIsImRvYyI6IkRlbGV0ZWQgcm93cyBjb3VudCJ9LHsiaWQiOjUwNywibmFtZSI6InBhcnRpdGlvbnMiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOnsidHlwZSI6Imxpc3QiLCJlbGVtZW50LWlkIjo1MDgsImVsZW1lbnQiOnsidHlwZSI6InN0cnVjdCIsImZpZWxkcyI6W3siaWQiOjUwOSwibmFtZSI6ImNvbnRhaW5zX251bGwiLCJyZXF1aXJlZCI6dHJ1ZSwidHlwZSI6ImJvb2xlYW4iLCJkb2MiOiJUcnVlIGlmIGFueSBmaWxlIGhhcyBhIG51bGwgcGFydGl0aW9uIHZhbHVlIn0seyJpZCI6NTE4LCJuYW1lIjoiY29udGFpbnNfbmFuIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoiYm9vbGVhbiIsImRvYyI6IlRydWUgaWYgYW55IGZpbGUgaGFzIGEgbmFuIHBhcnRpdGlvbiB2YWx1ZSJ9LHsiaWQiOjUxMCwibmFtZSI6Imxvd2VyX2JvdW5kIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoiYmluYXJ5IiwiZG9jIjoiUGFydGl0aW9uIGxvd2VyIGJvdW5kIGZvciBhbGwgZmlsZXMifSx7ImlkIjo1MTEsIm5hbWUiOiJ1cHBlcl9ib3VuZCIsInJlcXVpcmVkIjpmYWxzZSwidHlwZSI6ImJpbmFyeSIsImRvYyI6IlBhcnRpdGlvbiB1cHBlciBib3VuZCBmb3IgYWxsIGZpbGVzIn1dfSwiZWxlbWVudC1yZXF1aXJlZCI6dHJ1ZX0sImRvYyI6IlN1bW1hcnkgZm9yIGVhY2ggcGFydGl0aW9uIn1dfSRwYXJlbnQtc25hcHNob3QtaWQIbnVsbAB5/+JEuAZU5rF05VN5K42DArICNcxBCsIwEEDRtPeJSUPSNKcZppOJFaqVJnoFwVuI4tJbCF7EtRdwoQhu/4N/rdWKuOd5CRELqsgJd2NRhXOBv+QNbvMwFZgZYzYwToQjeDKdaUkDWufAeqehY2OhSZRMCMl76tWaC/7GpBtN2BtJsdHSsm5liC7K1hoMBl3orJZrvcD9PL0HIer6cjzcn6fX7VzVQjyqbxIfef/iRLgGVOaxdOVTeSuNgw== | base64 --decode > /iceberg_data/default/test_iceberg_snapshot_reads2_local_7c2826c0_a455_4750_8e24_1fcf299f77cb/metadata/snap-5885886435165266578-1-c010cab2-cd10-4e06-9d5d-642a92a59840.avro'] (cluster.py:2045, exec_in_container) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command:[docker exec rootteststorageiceberg-gw1-node1-1 bash -c mkdir -p $(dirname /iceberg_data/default/test_iceberg_snapshot_reads2_local_7c2826c0_a455_4750_8e24_1fcf299f77cb/metadata/snap-5885886435165266578-1-c010cab2-cd10-4e06-9d5d-642a92a59840.avro) && echo T2JqAQ4WYXZyby5zY2hlbWGeHnsidHlwZSI6InJlY29yZCIsIm5hbWUiOiJtYW5pZmVzdF9maWxlIiwiZmllbGRzIjpbeyJuYW1lIjoibWFuaWZlc3RfcGF0aCIsInR5cGUiOiJzdHJpbmciLCJkb2MiOiJMb2NhdGlvbiBVUkkgd2l0aCBGUyBzY2hlbWUiLCJmaWVsZC1pZCI6NTAwfSx7Im5hbWUiOiJtYW5pZmVzdF9sZW5ndGgiLCJ0eXBlIjoibG9uZyIsImRvYyI6IlRvdGFsIGZpbGUgc2l6ZSBpbiBieXRlcyIsImZpZWxkLWlkIjo1MDF9LHsibmFtZSI6InBhcnRpdGlvbl9zcGVjX2lkIiwidHlwZSI6ImludCIsImRvYyI6IlNwZWMgSUQgdXNlZCB0byB3cml0ZSIsImZpZWxkLWlkIjo1MDJ9LHsibmFtZSI6ImNvbnRlbnQiLCJ0eXBlIjoiaW50IiwiZG9jIjoiQ29udGVudHMgb2YgdGhlIG1hbmlmZXN0OiAwPWRhdGEsIDE9ZGVsZXRlcyIsImZpZWxkLWlkIjo1MTd9LHsibmFtZSI6InNlcXVlbmNlX251bWJlciIsInR5cGUiOiJsb25nIiwiZG9jIjoiU2VxdWVuY2UgbnVtYmVyIHdoZW4gdGhlIG1hbmlmZXN0IHdhcyBhZGRlZCIsImZpZWxkLWlkIjo1MTV9LHsibmFtZSI6Im1pbl9zZXF1ZW5jZV9udW1iZXIiLCJ0eXBlIjoibG9uZyIsImRvYyI6Ikxvd2VzdCBzZXF1ZW5jZSBudW1iZXIgaW4gdGhlIG1hbmlmZXN0IiwiZmllbGQtaWQiOjUxNn0seyJuYW1lIjoiYWRkZWRfc25hcHNob3RfaWQiLCJ0eXBlIjoibG9uZyIsImRvYyI6IlNuYXBzaG90IElEIHRoYXQgYWRkZWQgdGhlIG1hbmlmZXN0IiwiZmllbGQtaWQiOjUwM30seyJuYW1lIjoiYWRkZWRfZGF0YV9maWxlc19jb3VudCIsInR5cGUiOiJpbnQiLCJkb2MiOiJBZGRlZCBlbnRyeSBjb3VudCIsImZpZWxkLWlkIjo1MDR9LHsibmFtZSI6ImV4aXN0aW5nX2RhdGFfZmlsZXNfY291bnQiLCJ0eXBlIjoiaW50IiwiZG9jIjoiRXhpc3RpbmcgZW50cnkgY291bnQiLCJmaWVsZC1pZCI6NTA1fSx7Im5hbWUiOiJkZWxldGVkX2RhdGFfZmlsZXNfY291bnQiLCJ0eXBlIjoiaW50IiwiZG9jIjoiRGVsZXRlZCBlbnRyeSBjb3VudCIsImZpZWxkLWlkIjo1MDZ9LHsibmFtZSI6ImFkZGVkX3Jvd3NfY291bnQiLCJ0eXBlIjoibG9uZyIsImRvYyI6IkFkZGVkIHJvd3MgY291bnQiLCJmaWVsZC1pZCI6NTEyfSx7Im5hbWUiOiJleGlzdGluZ19yb3dzX2NvdW50IiwidHlwZSI6ImxvbmciLCJkb2MiOiJFeGlzdGluZyByb3dzIGNvdW50IiwiZmllbGQtaWQiOjUxM30seyJuYW1lIjoiZGVsZXRlZF9yb3dzX2NvdW50IiwidHlwZSI6ImxvbmciLCJkb2MiOiJEZWxldGVkIHJvd3MgY291bnQiLCJmaWVsZC1pZCI6NTE0fSx7Im5hbWUiOiJwYXJ0aXRpb25zIiwidHlwZSI6WyJudWxsIix7InR5cGUiOiJhcnJheSIsIml0ZW1zIjp7InR5cGUiOiJyZWNvcmQiLCJuYW1lIjoicjUwOCIsImZpZWxkcyI6W3sibmFtZSI6ImNvbnRhaW5zX251bGwiLCJ0eXBlIjoiYm9vbGVhbiIsImRvYyI6IlRydWUgaWYgYW55IGZpbGUgaGFzIGEgbnVsbCBwYXJ0aXRpb24gdmFsdWUiLCJmaWVsZC1pZCI6NTA5fSx7Im5hbWUiOiJjb250YWluc19uYW4iLCJ0eXBlIjpbIm51bGwiLCJib29sZWFuIl0sImRvYyI6IlRydWUgaWYgYW55IGZpbGUgaGFzIGEgbmFuIHBhcnRpdGlvbiB2YWx1ZSIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjo1MTh9LHsibmFtZSI6Imxvd2VyX2JvdW5kIiwidHlwZSI6WyJudWxsIiwiYnl0ZXMiXSwiZG9jIjoiUGFydGl0aW9uIGxvd2VyIGJvdW5kIGZvciBhbGwgZmlsZXMiLCJkZWZhdWx0IjpudWxsLCJmaWVsZC1pZCI6NTEwfSx7Im5hbWUiOiJ1cHBlcl9ib3VuZCIsInR5cGUiOlsibnVsbCIsImJ5dGVzIl0sImRvYyI6IlBhcnRpdGlvbiB1cHBlciBib3VuZCBmb3IgYWxsIGZpbGVzIiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjUxMX1dfSwiZWxlbWVudC1pZCI6NTA4fV0sImRvYyI6IlN1bW1hcnkgZm9yIGVhY2ggcGFydGl0aW9uIiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjUwN31dfRRhdnJvLmNvZGVjDmRlZmxhdGUWc25hcHNob3QtaWQmNTg4NTg4NjQzNTE2NTI2NjU3OBxmb3JtYXQtdmVyc2lvbgIyHnNlcXVlbmNlLW51bWJlcgIxHGljZWJlcmcuc2NoZW1h1h97InR5cGUiOiJzdHJ1Y3QiLCJzY2hlbWEtaWQiOjAsImZpZWxkcyI6W3siaWQiOjUwMCwibmFtZSI6Im1hbmlmZXN0X3BhdGgiLCJyZXF1aXJlZCI6dHJ1ZSwidHlwZSI6InN0cmluZyIsImRvYyI6IkxvY2F0aW9uIFVSSSB3aXRoIEZTIHNjaGVtZSJ9LHsiaWQiOjUwMSwibmFtZSI6Im1hbmlmZXN0X2xlbmd0aCIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjoibG9uZyIsImRvYyI6IlRvdGFsIGZpbGUgc2l6ZSBpbiBieXRlcyJ9LHsiaWQiOjUwMiwibmFtZSI6InBhcnRpdGlvbl9zcGVjX2lkIiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJpbnQiLCJkb2MiOiJTcGVjIElEIHVzZWQgdG8gd3JpdGUifSx7ImlkIjo1MTcsIm5hbWUiOiJjb250ZW50IiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJpbnQiLCJkb2MiOiJDb250ZW50cyBvZiB0aGUgbWFuaWZlc3Q6IDA9ZGF0YSwgMT1kZWxldGVzIn0seyJpZCI6NTE1LCJuYW1lIjoic2VxdWVuY2VfbnVtYmVyIiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJsb25nIiwiZG9jIjoiU2VxdWVuY2UgbnVtYmVyIHdoZW4gdGhlIG1hbmlmZXN0IHdhcyBhZGRlZCJ9LHsiaWQiOjUxNiwibmFtZSI6Im1pbl9zZXF1ZW5jZV9udW1iZXIiLCJyZXF1aXJlZCI6dHJ1ZSwidHlwZSI6ImxvbmciLCJkb2MiOiJMb3dlc3Qgc2VxdWVuY2UgbnVtYmVyIGluIHRoZSBtYW5pZmVzdCJ9LHsiaWQiOjUwMywibmFtZSI6ImFkZGVkX3NuYXBzaG90X2lkIiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJsb25nIiwiZG9jIjoiU25hcHNob3QgSUQgdGhhdCBhZGRlZCB0aGUgbWFuaWZlc3QifSx7ImlkIjo1MDQsIm5hbWUiOiJhZGRlZF9kYXRhX2ZpbGVzX2NvdW50IiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJpbnQiLCJkb2MiOiJBZGRlZCBlbnRyeSBjb3VudCJ9LHsiaWQiOjUwNSwibmFtZSI6ImV4aXN0aW5nX2RhdGFfZmlsZXNfY291bnQiLCJyZXF1aXJlZCI6dHJ1ZSwidHlwZSI6ImludCIsImRvYyI6IkV4aXN0aW5nIGVudHJ5IGNvdW50In0seyJpZCI6NTA2LCJuYW1lIjoiZGVsZXRlZF9kYXRhX2ZpbGVzX2NvdW50IiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJpbnQiLCJkb2MiOiJEZWxldGVkIGVudHJ5IGNvdW50In0seyJpZCI6NTEyLCJuYW1lIjoiYWRkZWRfcm93c19jb3VudCIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjoibG9uZyIsImRvYyI6IkFkZGVkIHJvd3MgY291bnQifSx7ImlkIjo1MTMsIm5hbWUiOiJleGlzdGluZ19yb3dzX2NvdW50IiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJsb25nIiwiZG9jIjoiRXhpc3Rpbmcgcm93cyBjb3VudCJ9LHsiaWQiOjUxNCwibmFtZSI6ImRlbGV0ZWRfcm93c19jb3VudCIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjoibG9uZyIsImRvYyI6IkRlbGV0ZWQgcm93cyBjb3VudCJ9LHsiaWQiOjUwNywibmFtZSI6InBhcnRpdGlvbnMiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOnsidHlwZSI6Imxpc3QiLCJlbGVtZW50LWlkIjo1MDgsImVsZW1lbnQiOnsidHlwZSI6InN0cnVjdCIsImZpZWxkcyI6W3siaWQiOjUwOSwibmFtZSI6ImNvbnRhaW5zX251bGwiLCJyZXF1aXJlZCI6dHJ1ZSwidHlwZSI6ImJvb2xlYW4iLCJkb2MiOiJUcnVlIGlmIGFueSBmaWxlIGhhcyBhIG51bGwgcGFydGl0aW9uIHZhbHVlIn0seyJpZCI6NTE4LCJuYW1lIjoiY29udGFpbnNfbmFuIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoiYm9vbGVhbiIsImRvYyI6IlRydWUgaWYgYW55IGZpbGUgaGFzIGEgbmFuIHBhcnRpdGlvbiB2YWx1ZSJ9LHsiaWQiOjUxMCwibmFtZSI6Imxvd2VyX2JvdW5kIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoiYmluYXJ5IiwiZG9jIjoiUGFydGl0aW9uIGxvd2VyIGJvdW5kIGZvciBhbGwgZmlsZXMifSx7ImlkIjo1MTEsIm5hbWUiOiJ1cHBlcl9ib3VuZCIsInJlcXVpcmVkIjpmYWxzZSwidHlwZSI6ImJpbmFyeSIsImRvYyI6IlBhcnRpdGlvbiB1cHBlciBib3VuZCBmb3IgYWxsIGZpbGVzIn1dfSwiZWxlbWVudC1yZXF1aXJlZCI6dHJ1ZX0sImRvYyI6IlN1bW1hcnkgZm9yIGVhY2ggcGFydGl0aW9uIn1dfSRwYXJlbnQtc25hcHNob3QtaWQIbnVsbAB5/+JEuAZU5rF05VN5K42DArICNcxBCsIwEEDRtPeJSUPSNKcZppOJFaqVJnoFwVuI4tJbCF7EtRdwoQhu/4N/rdWKuOd5CRELqsgJd2NRhXOBv+QNbvMwFZgZYzYwToQjeDKdaUkDWufAeqehY2OhSZRMCMl76tWaC/7GpBtN2BtJsdHSsm5liC7K1hoMBl3orJZrvcD9PL0HIer6cjzcn6fX7VzVQjyqbxIfef/iRLgGVOaxdOVTeSuNgw== | base64 --decode > /iceberg_data/default/test_iceberg_snapshot_reads2_local_7c2826c0_a455_4750_8e24_1fcf299f77cb/metadata/snap-5885886435165266578-1-c010cab2-cd10-4e06-9d5d-642a92a59840.avro] (cluster.py:121, run_and_check) 2025-05-23 21:10:57 [ 671 ] DEBUG : run container_id:rootteststorageiceberg-gw1-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p /iceberg_data/default/test_iceberg_snapshot_reads2_local_7c2826c0_a455_4750_8e24_1fcf299f77cb/metadata'] (cluster.py:2045, exec_in_container) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command:[docker exec rootteststorageiceberg-gw1-node1-1 bash -c mkdir -p /iceberg_data/default/test_iceberg_snapshot_reads2_local_7c2826c0_a455_4750_8e24_1fcf299f77cb/metadata] (cluster.py:121, run_and_check) 2025-05-23 21:10:57 [ 671 ] DEBUG : run container_id:rootteststorageiceberg-gw1-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname /iceberg_data/default/test_iceberg_snapshot_reads2_local_7c2826c0_a455_4750_8e24_1fcf299f77cb/metadata/c010cab2-cd10-4e06-9d5d-642a92a59840-m0.avro) && echo T2JqARAMc2NoZW1hpAJ7InR5cGUiOiJzdHJ1Y3QiLCJzY2hlbWEtaWQiOjAsImZpZWxkcyI6W3siaWQiOjEsIm5hbWUiOiJhIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoibG9uZyJ9LHsiaWQiOjIsIm5hbWUiOiJiIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoic3RyaW5nIn1dfRZhdnJvLnNjaGVtYZI1eyJ0eXBlIjoicmVjb3JkIiwibmFtZSI6Im1hbmlmZXN0X2VudHJ5IiwiZmllbGRzIjpbeyJuYW1lIjoic3RhdHVzIiwidHlwZSI6ImludCIsImZpZWxkLWlkIjowfSx7Im5hbWUiOiJzbmFwc2hvdF9pZCIsInR5cGUiOlsibnVsbCIsImxvbmciXSwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjF9LHsibmFtZSI6InNlcXVlbmNlX251bWJlciIsInR5cGUiOlsibnVsbCIsImxvbmciXSwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjN9LHsibmFtZSI6ImZpbGVfc2VxdWVuY2VfbnVtYmVyIiwidHlwZSI6WyJudWxsIiwibG9uZyJdLCJkZWZhdWx0IjpudWxsLCJmaWVsZC1pZCI6NH0seyJuYW1lIjoiZGF0YV9maWxlIiwidHlwZSI6eyJ0eXBlIjoicmVjb3JkIiwibmFtZSI6InIyIiwiZmllbGRzIjpbeyJuYW1lIjoiY29udGVudCIsInR5cGUiOiJpbnQiLCJkb2MiOiJDb250ZW50cyBvZiB0aGUgZmlsZTogMD1kYXRhLCAxPXBvc2l0aW9uIGRlbGV0ZXMsIDI9ZXF1YWxpdHkgZGVsZXRlcyIsImZpZWxkLWlkIjoxMzR9LHsibmFtZSI6ImZpbGVfcGF0aCIsInR5cGUiOiJzdHJpbmciLCJkb2MiOiJMb2NhdGlvbiBVUkkgd2l0aCBGUyBzY2hlbWUiLCJmaWVsZC1pZCI6MTAwfSx7Im5hbWUiOiJmaWxlX2Zvcm1hdCIsInR5cGUiOiJzdHJpbmciLCJkb2MiOiJGaWxlIGZvcm1hdCBuYW1lOiBhdnJvLCBvcmMsIG9yIHBhcnF1ZXQiLCJmaWVsZC1pZCI6MTAxfSx7Im5hbWUiOiJwYXJ0aXRpb24iLCJ0eXBlIjp7InR5cGUiOiJyZWNvcmQiLCJuYW1lIjoicjEwMiIsImZpZWxkcyI6W119LCJkb2MiOiJQYXJ0aXRpb24gZGF0YSB0dXBsZSwgc2NoZW1hIGJhc2VkIG9uIHRoZSBwYXJ0aXRpb24gc3BlYyIsImZpZWxkLWlkIjoxMDJ9LHsibmFtZSI6InJlY29yZF9jb3VudCIsInR5cGUiOiJsb25nIiwiZG9jIjoiTnVtYmVyIG9mIHJlY29yZHMgaW4gdGhlIGZpbGUiLCJmaWVsZC1pZCI6MTAzfSx7Im5hbWUiOiJmaWxlX3NpemVfaW5fYnl0ZXMiLCJ0eXBlIjoibG9uZyIsImRvYyI6IlRvdGFsIGZpbGUgc2l6ZSBpbiBieXRlcyIsImZpZWxkLWlkIjoxMDR9LHsibmFtZSI6ImNvbHVtbl9zaXplcyIsInR5cGUiOlsibnVsbCIseyJ0eXBlIjoiYXJyYXkiLCJpdGVtcyI6eyJ0eXBlIjoicmVjb3JkIiwibmFtZSI6ImsxMTdfdjExOCIsImZpZWxkcyI6W3sibmFtZSI6ImtleSIsInR5cGUiOiJpbnQiLCJmaWVsZC1pZCI6MTE3fSx7Im5hbWUiOiJ2YWx1ZSIsInR5cGUiOiJsb25nIiwiZmllbGQtaWQiOjExOH1dfSwibG9naWNhbFR5cGUiOiJtYXAifV0sImRvYyI6Ik1hcCBvZiBjb2x1bW4gaWQgdG8gdG90YWwgc2l6ZSBvbiBkaXNrIiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjEwOH0seyJuYW1lIjoidmFsdWVfY291bnRzIiwidHlwZSI6WyJudWxsIix7InR5cGUiOiJhcnJheSIsIml0ZW1zIjp7InR5cGUiOiJyZWNvcmQiLCJuYW1lIjoiazExOV92MTIwIiwiZmllbGRzIjpbeyJuYW1lIjoia2V5IiwidHlwZSI6ImludCIsImZpZWxkLWlkIjoxMTl9LHsibmFtZSI6InZhbHVlIiwidHlwZSI6ImxvbmciLCJmaWVsZC1pZCI6MTIwfV19LCJsb2dpY2FsVHlwZSI6Im1hcCJ9XSwiZG9jIjoiTWFwIG9mIGNvbHVtbiBpZCB0byB0b3RhbCBjb3VudCwgaW5jbHVkaW5nIG51bGwgYW5kIE5hTiIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjoxMDl9LHsibmFtZSI6Im51bGxfdmFsdWVfY291bnRzIiwidHlwZSI6WyJudWxsIix7InR5cGUiOiJhcnJheSIsIml0ZW1zIjp7InR5cGUiOiJyZWNvcmQiLCJuYW1lIjoiazEyMV92MTIyIiwiZmllbGRzIjpbeyJuYW1lIjoia2V5IiwidHlwZSI6ImludCIsImZpZWxkLWlkIjoxMjF9LHsibmFtZSI6InZhbHVlIiwidHlwZSI6ImxvbmciLCJmaWVsZC1pZCI6MTIyfV19LCJsb2dpY2FsVHlwZSI6Im1hcCJ9XSwiZG9jIjoiTWFwIG9mIGNvbHVtbiBpZCB0byBudWxsIHZhbHVlIGNvdW50IiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjExMH0seyJuYW1lIjoibmFuX3ZhbHVlX2NvdW50cyIsInR5cGUiOlsibnVsbCIseyJ0eXBlIjoiYXJyYXkiLCJpdGVtcyI6eyJ0eXBlIjoicmVjb3JkIiwibmFtZSI6ImsxMzhfdjEzOSIsImZpZWxkcyI6W3sibmFtZSI6ImtleSIsInR5cGUiOiJpbnQiLCJmaWVsZC1pZCI6MTM4fSx7Im5hbWUiOiJ2YWx1ZSIsInR5cGUiOiJsb25nIiwiZmllbGQtaWQiOjEzOX1dfSwibG9naWNhbFR5cGUiOiJtYXAifV0sImRvYyI6Ik1hcCBvZiBjb2x1bW4gaWQgdG8gbnVtYmVyIG9mIE5hTiB2YWx1ZXMgaW4gdGhlIGNvbHVtbiIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjoxMzd9LHsibmFtZSI6Imxvd2VyX2JvdW5kcyIsInR5cGUiOlsibnVsbCIseyJ0eXBlIjoiYXJyYXkiLCJpdGVtcyI6eyJ0eXBlIjoicmVjb3JkIiwibmFtZSI6ImsxMjZfdjEyNyIsImZpZWxkcyI6W3sibmFtZSI6ImtleSIsInR5cGUiOiJpbnQiLCJmaWVsZC1pZCI6MTI2fSx7Im5hbWUiOiJ2YWx1ZSIsInR5cGUiOiJieXRlcyIsImZpZWxkLWlkIjoxMjd9XX0sImxvZ2ljYWxUeXBlIjoibWFwIn1dLCJkb2MiOiJNYXAgb2YgY29sdW1uIGlkIHRvIGxvd2VyIGJvdW5kIiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjEyNX0seyJuYW1lIjoidXBwZXJfYm91bmRzIiwidHlwZSI6WyJudWxsIix7InR5cGUiOiJhcnJheSIsIml0ZW1zIjp7InR5cGUiOiJyZWNvcmQiLCJuYW1lIjoiazEyOV92MTMwIiwiZmllbGRzIjpbeyJuYW1lIjoia2V5IiwidHlwZSI6ImludCIsImZpZWxkLWlkIjoxMjl9LHsibmFtZSI6InZhbHVlIiwidHlwZSI6ImJ5dGVzIiwiZmllbGQtaWQiOjEzMH1dfSwibG9naWNhbFR5cGUiOiJtYXAifV0sImRvYyI6Ik1hcCBvZiBjb2x1bW4gaWQgdG8gdXBwZXIgYm91bmQiLCJkZWZhdWx0IjpudWxsLCJmaWVsZC1pZCI6MTI4fSx7Im5hbWUiOiJrZXlfbWV0YWRhdGEiLCJ0eXBlIjpbIm51bGwiLCJieXRlcyJdLCJkb2MiOiJFbmNyeXB0aW9uIGtleSBtZXRhZGF0YSBibG9iIiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjEzMX0seyJuYW1lIjoic3BsaXRfb2Zmc2V0cyIsInR5cGUiOlsibnVsbCIseyJ0eXBlIjoiYXJyYXkiLCJpdGVtcyI6ImxvbmciLCJlbGVtZW50LWlkIjoxMzN9XSwiZG9jIjoiU3BsaXR0YWJsZSBvZmZzZXRzIiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjEzMn0seyJuYW1lIjoiZXF1YWxpdHlfaWRzIiwidHlwZSI6WyJudWxsIix7InR5cGUiOiJhcnJheSIsIml0ZW1zIjoiaW50IiwiZWxlbWVudC1pZCI6MTM2fV0sImRvYyI6IkVxdWFsaXR5IGNvbXBhcmlzb24gZmllbGQgSURzIiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjEzNX0seyJuYW1lIjoic29ydF9vcmRlcl9pZCIsInR5cGUiOlsibnVsbCIsImludCJdLCJkb2MiOiJTb3J0IG9yZGVyIElEIiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjE0MH1dfSwiZmllbGQtaWQiOjJ9XX0UYXZyby5jb2RlYw5kZWZsYXRlHGZvcm1hdC12ZXJzaW9uAjIicGFydGl0aW9uLXNwZWMtaWQCMBxpY2ViZXJnLnNjaGVtYcoreyJ0eXBlIjoic3RydWN0Iiwic2NoZW1hLWlkIjowLCJmaWVsZHMiOlt7ImlkIjowLCJuYW1lIjoic3RhdHVzIiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJpbnQifSx7ImlkIjoxLCJuYW1lIjoic25hcHNob3RfaWQiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOiJsb25nIn0seyJpZCI6MywibmFtZSI6InNlcXVlbmNlX251bWJlciIsInJlcXVpcmVkIjpmYWxzZSwidHlwZSI6ImxvbmcifSx7ImlkIjo0LCJuYW1lIjoiZmlsZV9zZXF1ZW5jZV9udW1iZXIiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOiJsb25nIn0seyJpZCI6MiwibmFtZSI6ImRhdGFfZmlsZSIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjp7InR5cGUiOiJzdHJ1Y3QiLCJmaWVsZHMiOlt7ImlkIjoxMzQsIm5hbWUiOiJjb250ZW50IiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJpbnQiLCJkb2MiOiJDb250ZW50cyBvZiB0aGUgZmlsZTogMD1kYXRhLCAxPXBvc2l0aW9uIGRlbGV0ZXMsIDI9ZXF1YWxpdHkgZGVsZXRlcyJ9LHsiaWQiOjEwMCwibmFtZSI6ImZpbGVfcGF0aCIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjoic3RyaW5nIiwiZG9jIjoiTG9jYXRpb24gVVJJIHdpdGggRlMgc2NoZW1lIn0seyJpZCI6MTAxLCJuYW1lIjoiZmlsZV9mb3JtYXQiLCJyZXF1aXJlZCI6dHJ1ZSwidHlwZSI6InN0cmluZyIsImRvYyI6IkZpbGUgZm9ybWF0IG5hbWU6IGF2cm8sIG9yYywgb3IgcGFycXVldCJ9LHsiaWQiOjEwMiwibmFtZSI6InBhcnRpdGlvbiIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjp7InR5cGUiOiJzdHJ1Y3QiLCJmaWVsZHMiOltdfSwiZG9jIjoiUGFydGl0aW9uIGRhdGEgdHVwbGUsIHNjaGVtYSBiYXNlZCBvbiB0aGUgcGFydGl0aW9uIHNwZWMifSx7ImlkIjoxMDMsIm5hbWUiOiJyZWNvcmRfY291bnQiLCJyZXF1aXJlZCI6dHJ1ZSwidHlwZSI6ImxvbmciLCJkb2MiOiJOdW1iZXIgb2YgcmVjb3JkcyBpbiB0aGUgZmlsZSJ9LHsiaWQiOjEwNCwibmFtZSI6ImZpbGVfc2l6ZV9pbl9ieXRlcyIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjoibG9uZyIsImRvYyI6IlRvdGFsIGZpbGUgc2l6ZSBpbiBieXRlcyJ9LHsiaWQiOjEwOCwibmFtZSI6ImNvbHVtbl9zaXplcyIsInJlcXVpcmVkIjpmYWxzZSwidHlwZSI6eyJ0eXBlIjoibWFwIiwia2V5LWlkIjoxMTcsImtleSI6ImludCIsInZhbHVlLWlkIjoxMTgsInZhbHVlIjoibG9uZyIsInZhbHVlLXJlcXVpcmVkIjp0cnVlfSwiZG9jIjoiTWFwIG9mIGNvbHVtbiBpZCB0byB0b3RhbCBzaXplIG9uIGRpc2sifSx7ImlkIjoxMDksIm5hbWUiOiJ2YWx1ZV9jb3VudHMiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOnsidHlwZSI6Im1hcCIsImtleS1pZCI6MTE5LCJrZXkiOiJpbnQiLCJ2YWx1ZS1pZCI6MTIwLCJ2YWx1ZSI6ImxvbmciLCJ2YWx1ZS1yZXF1aXJlZCI6dHJ1ZX0sImRvYyI6Ik1hcCBvZiBjb2x1bW4gaWQgdG8gdG90YWwgY291bnQsIGluY2x1ZGluZyBudWxsIGFuZCBOYU4ifSx7ImlkIjoxMTAsIm5hbWUiOiJudWxsX3ZhbHVlX2NvdW50cyIsInJlcXVpcmVkIjpmYWxzZSwidHlwZSI6eyJ0eXBlIjoibWFwIiwia2V5LWlkIjoxMjEsImtleSI6ImludCIsInZhbHVlLWlkIjoxMjIsInZhbHVlIjoibG9uZyIsInZhbHVlLXJlcXVpcmVkIjp0cnVlfSwiZG9jIjoiTWFwIG9mIGNvbHVtbiBpZCB0byBudWxsIHZhbHVlIGNvdW50In0seyJpZCI6MTM3LCJuYW1lIjoibmFuX3ZhbHVlX2NvdW50cyIsInJlcXVpcmVkIjpmYWxzZSwidHlwZSI6eyJ0eXBlIjoibWFwIiwia2V5LWlkIjoxMzgsImtleSI6ImludCIsInZhbHVlLWlkIjoxMzksInZhbHVlIjoibG9uZyIsInZhbHVlLXJlcXVpcmVkIjp0cnVlfSwiZG9jIjoiTWFwIG9mIGNvbHVtbiBpZCB0byBudW1iZXIgb2YgTmFOIHZhbHVlcyBpbiB0aGUgY29sdW1uIn0seyJpZCI6MTI1LCJuYW1lIjoibG93ZXJfYm91bmRzIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjp7InR5cGUiOiJtYXAiLCJrZXktaWQiOjEyNiwia2V5IjoiaW50IiwidmFsdWUtaWQiOjEyNywidmFsdWUiOiJiaW5hcnkiLCJ2YWx1ZS1yZXF1aXJlZCI6dHJ1ZX0sImRvYyI6Ik1hcCBvZiBjb2x1bW4gaWQgdG8gbG93ZXIgYm91bmQifSx7ImlkIjoxMjgsIm5hbWUiOiJ1cHBlcl9ib3VuZHMiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOnsidHlwZSI6Im1hcCIsImtleS1pZCI6MTI5LCJrZXkiOiJpbnQiLCJ2YWx1ZS1pZCI6MTMwLCJ2YWx1ZSI6ImJpbmFyeSIsInZhbHVlLXJlcXVpcmVkIjp0cnVlfSwiZG9jIjoiTWFwIG9mIGNvbHVtbiBpZCB0byB1cHBlciBib3VuZCJ9LHsiaWQiOjEzMSwibmFtZSI6ImtleV9tZXRhZGF0YSIsInJlcXVpcmVkIjpmYWxzZSwidHlwZSI6ImJpbmFyeSIsImRvYyI6IkVuY3J5cHRpb24ga2V5IG1ldGFkYXRhIGJsb2IifSx7ImlkIjoxMzIsIm5hbWUiOiJzcGxpdF9vZmZzZXRzIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjp7InR5cGUiOiJsaXN0IiwiZWxlbWVudC1pZCI6MTMzLCJlbGVtZW50IjoibG9uZyIsImVsZW1lbnQtcmVxdWlyZWQiOnRydWV9LCJkb2MiOiJTcGxpdHRhYmxlIG9mZnNldHMifSx7ImlkIjoxMzUsIm5hbWUiOiJlcXVhbGl0eV9pZHMiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOnsidHlwZSI6Imxpc3QiLCJlbGVtZW50LWlkIjoxMzYsImVsZW1lbnQiOiJpbnQiLCJlbGVtZW50LXJlcXVpcmVkIjp0cnVlfSwiZG9jIjoiRXF1YWxpdHkgY29tcGFyaXNvbiBmaWVsZCBJRHMifSx7ImlkIjoxNDAsIm5hbWUiOiJzb3J0X29yZGVyX2lkIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoiaW50IiwiZG9jIjoiU29ydCBvcmRlciBJRCJ9XX19XX0ccGFydGl0aW9uLXNwZWMEW10OY29udGVudAhkYXRhAEnkvCjWSpNuA0bpbRUz+dECrAM1jD1OAzEUhL2OCyrgIs56vfbaLlPQA4L66cU/gLQiYdc5AxIFR0BCUFFwAlqkvUjqXIE4IlN9o/k0lH6+PP9u33ffHxUh5IfWDz4u43AHATPWISbc9LnOccxwXMZHXI/3qwxDxDBK6FceezBeWtl5Aai0BmW0ABulgib5JJ1LxvhlfTgVJVy1PLguJCElF6oJXEnU3GrtOZrQWRFs26bEi9zM1zg8bWI+vVxcX91e3EzV6xll9GvG3mZkD1PFpqoAYYTQAufkP4w2h+6PnTm3d+hJEf8ASeS8KNZKk24DRultFTP50Q== | base64 --decode > /iceberg_data/default/test_iceberg_snapshot_reads2_local_7c2826c0_a455_4750_8e24_1fcf299f77cb/metadata/c010cab2-cd10-4e06-9d5d-642a92a59840-m0.avro'] (cluster.py:2045, exec_in_container) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command:[docker exec rootteststorageiceberg-gw1-node1-1 bash -c mkdir -p $(dirname /iceberg_data/default/test_iceberg_snapshot_reads2_local_7c2826c0_a455_4750_8e24_1fcf299f77cb/metadata/c010cab2-cd10-4e06-9d5d-642a92a59840-m0.avro) && echo T2JqARAMc2NoZW1hpAJ7InR5cGUiOiJzdHJ1Y3QiLCJzY2hlbWEtaWQiOjAsImZpZWxkcyI6W3siaWQiOjEsIm5hbWUiOiJhIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoibG9uZyJ9LHsiaWQiOjIsIm5hbWUiOiJiIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoic3RyaW5nIn1dfRZhdnJvLnNjaGVtYZI1eyJ0eXBlIjoicmVjb3JkIiwibmFtZSI6Im1hbmlmZXN0X2VudHJ5IiwiZmllbGRzIjpbeyJuYW1lIjoic3RhdHVzIiwidHlwZSI6ImludCIsImZpZWxkLWlkIjowfSx7Im5hbWUiOiJzbmFwc2hvdF9pZCIsInR5cGUiOlsibnVsbCIsImxvbmciXSwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjF9LHsibmFtZSI6InNlcXVlbmNlX251bWJlciIsInR5cGUiOlsibnVsbCIsImxvbmciXSwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjN9LHsibmFtZSI6ImZpbGVfc2VxdWVuY2VfbnVtYmVyIiwidHlwZSI6WyJudWxsIiwibG9uZyJdLCJkZWZhdWx0IjpudWxsLCJmaWVsZC1pZCI6NH0seyJuYW1lIjoiZGF0YV9maWxlIiwidHlwZSI6eyJ0eXBlIjoicmVjb3JkIiwibmFtZSI6InIyIiwiZmllbGRzIjpbeyJuYW1lIjoiY29udGVudCIsInR5cGUiOiJpbnQiLCJkb2MiOiJDb250ZW50cyBvZiB0aGUgZmlsZTogMD1kYXRhLCAxPXBvc2l0aW9uIGRlbGV0ZXMsIDI9ZXF1YWxpdHkgZGVsZXRlcyIsImZpZWxkLWlkIjoxMzR9LHsibmFtZSI6ImZpbGVfcGF0aCIsInR5cGUiOiJzdHJpbmciLCJkb2MiOiJMb2NhdGlvbiBVUkkgd2l0aCBGUyBzY2hlbWUiLCJmaWVsZC1pZCI6MTAwfSx7Im5hbWUiOiJmaWxlX2Zvcm1hdCIsInR5cGUiOiJzdHJpbmciLCJkb2MiOiJGaWxlIGZvcm1hdCBuYW1lOiBhdnJvLCBvcmMsIG9yIHBhcnF1ZXQiLCJmaWVsZC1pZCI6MTAxfSx7Im5hbWUiOiJwYXJ0aXRpb24iLCJ0eXBlIjp7InR5cGUiOiJyZWNvcmQiLCJuYW1lIjoicjEwMiIsImZpZWxkcyI6W119LCJkb2MiOiJQYXJ0aXRpb24gZGF0YSB0dXBsZSwgc2NoZW1hIGJhc2VkIG9uIHRoZSBwYXJ0aXRpb24gc3BlYyIsImZpZWxkLWlkIjoxMDJ9LHsibmFtZSI6InJlY29yZF9jb3VudCIsInR5cGUiOiJsb25nIiwiZG9jIjoiTnVtYmVyIG9mIHJlY29yZHMgaW4gdGhlIGZpbGUiLCJmaWVsZC1pZCI6MTAzfSx7Im5hbWUiOiJmaWxlX3NpemVfaW5fYnl0ZXMiLCJ0eXBlIjoibG9uZyIsImRvYyI6IlRvdGFsIGZpbGUgc2l6ZSBpbiBieXRlcyIsImZpZWxkLWlkIjoxMDR9LHsibmFtZSI6ImNvbHVtbl9zaXplcyIsInR5cGUiOlsibnVsbCIseyJ0eXBlIjoiYXJyYXkiLCJpdGVtcyI6eyJ0eXBlIjoicmVjb3JkIiwibmFtZSI6ImsxMTdfdjExOCIsImZpZWxkcyI6W3sibmFtZSI6ImtleSIsInR5cGUiOiJpbnQiLCJmaWVsZC1pZCI6MTE3fSx7Im5hbWUiOiJ2YWx1ZSIsInR5cGUiOiJsb25nIiwiZmllbGQtaWQiOjExOH1dfSwibG9naWNhbFR5cGUiOiJtYXAifV0sImRvYyI6Ik1hcCBvZiBjb2x1bW4gaWQgdG8gdG90YWwgc2l6ZSBvbiBkaXNrIiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjEwOH0seyJuYW1lIjoidmFsdWVfY291bnRzIiwidHlwZSI6WyJudWxsIix7InR5cGUiOiJhcnJheSIsIml0ZW1zIjp7InR5cGUiOiJyZWNvcmQiLCJuYW1lIjoiazExOV92MTIwIiwiZmllbGRzIjpbeyJuYW1lIjoia2V5IiwidHlwZSI6ImludCIsImZpZWxkLWlkIjoxMTl9LHsibmFtZSI6InZhbHVlIiwidHlwZSI6ImxvbmciLCJmaWVsZC1pZCI6MTIwfV19LCJsb2dpY2FsVHlwZSI6Im1hcCJ9XSwiZG9jIjoiTWFwIG9mIGNvbHVtbiBpZCB0byB0b3RhbCBjb3VudCwgaW5jbHVkaW5nIG51bGwgYW5kIE5hTiIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjoxMDl9LHsibmFtZSI6Im51bGxfdmFsdWVfY291bnRzIiwidHlwZSI6WyJudWxsIix7InR5cGUiOiJhcnJheSIsIml0ZW1zIjp7InR5cGUiOiJyZWNvcmQiLCJuYW1lIjoiazEyMV92MTIyIiwiZmllbGRzIjpbeyJuYW1lIjoia2V5IiwidHlwZSI6ImludCIsImZpZWxkLWlkIjoxMjF9LHsibmFtZSI6InZhbHVlIiwidHlwZSI6ImxvbmciLCJmaWVsZC1pZCI6MTIyfV19LCJsb2dpY2FsVHlwZSI6Im1hcCJ9XSwiZG9jIjoiTWFwIG9mIGNvbHVtbiBpZCB0byBudWxsIHZhbHVlIGNvdW50IiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjExMH0seyJuYW1lIjoibmFuX3ZhbHVlX2NvdW50cyIsInR5cGUiOlsibnVsbCIseyJ0eXBlIjoiYXJyYXkiLCJpdGVtcyI6eyJ0eXBlIjoicmVjb3JkIiwibmFtZSI6ImsxMzhfdjEzOSIsImZpZWxkcyI6W3sibmFtZSI6ImtleSIsInR5cGUiOiJpbnQiLCJmaWVsZC1pZCI6MTM4fSx7Im5hbWUiOiJ2YWx1ZSIsInR5cGUiOiJsb25nIiwiZmllbGQtaWQiOjEzOX1dfSwibG9naWNhbFR5cGUiOiJtYXAifV0sImRvYyI6Ik1hcCBvZiBjb2x1bW4gaWQgdG8gbnVtYmVyIG9mIE5hTiB2YWx1ZXMgaW4gdGhlIGNvbHVtbiIsImRlZmF1bHQiOm51bGwsImZpZWxkLWlkIjoxMzd9LHsibmFtZSI6Imxvd2VyX2JvdW5kcyIsInR5cGUiOlsibnVsbCIseyJ0eXBlIjoiYXJyYXkiLCJpdGVtcyI6eyJ0eXBlIjoicmVjb3JkIiwibmFtZSI6ImsxMjZfdjEyNyIsImZpZWxkcyI6W3sibmFtZSI6ImtleSIsInR5cGUiOiJpbnQiLCJmaWVsZC1pZCI6MTI2fSx7Im5hbWUiOiJ2YWx1ZSIsInR5cGUiOiJieXRlcyIsImZpZWxkLWlkIjoxMjd9XX0sImxvZ2ljYWxUeXBlIjoibWFwIn1dLCJkb2MiOiJNYXAgb2YgY29sdW1uIGlkIHRvIGxvd2VyIGJvdW5kIiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjEyNX0seyJuYW1lIjoidXBwZXJfYm91bmRzIiwidHlwZSI6WyJudWxsIix7InR5cGUiOiJhcnJheSIsIml0ZW1zIjp7InR5cGUiOiJyZWNvcmQiLCJuYW1lIjoiazEyOV92MTMwIiwiZmllbGRzIjpbeyJuYW1lIjoia2V5IiwidHlwZSI6ImludCIsImZpZWxkLWlkIjoxMjl9LHsibmFtZSI6InZhbHVlIiwidHlwZSI6ImJ5dGVzIiwiZmllbGQtaWQiOjEzMH1dfSwibG9naWNhbFR5cGUiOiJtYXAifV0sImRvYyI6Ik1hcCBvZiBjb2x1bW4gaWQgdG8gdXBwZXIgYm91bmQiLCJkZWZhdWx0IjpudWxsLCJmaWVsZC1pZCI6MTI4fSx7Im5hbWUiOiJrZXlfbWV0YWRhdGEiLCJ0eXBlIjpbIm51bGwiLCJieXRlcyJdLCJkb2MiOiJFbmNyeXB0aW9uIGtleSBtZXRhZGF0YSBibG9iIiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjEzMX0seyJuYW1lIjoic3BsaXRfb2Zmc2V0cyIsInR5cGUiOlsibnVsbCIseyJ0eXBlIjoiYXJyYXkiLCJpdGVtcyI6ImxvbmciLCJlbGVtZW50LWlkIjoxMzN9XSwiZG9jIjoiU3BsaXR0YWJsZSBvZmZzZXRzIiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjEzMn0seyJuYW1lIjoiZXF1YWxpdHlfaWRzIiwidHlwZSI6WyJudWxsIix7InR5cGUiOiJhcnJheSIsIml0ZW1zIjoiaW50IiwiZWxlbWVudC1pZCI6MTM2fV0sImRvYyI6IkVxdWFsaXR5IGNvbXBhcmlzb24gZmllbGQgSURzIiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjEzNX0seyJuYW1lIjoic29ydF9vcmRlcl9pZCIsInR5cGUiOlsibnVsbCIsImludCJdLCJkb2MiOiJTb3J0IG9yZGVyIElEIiwiZGVmYXVsdCI6bnVsbCwiZmllbGQtaWQiOjE0MH1dfSwiZmllbGQtaWQiOjJ9XX0UYXZyby5jb2RlYw5kZWZsYXRlHGZvcm1hdC12ZXJzaW9uAjIicGFydGl0aW9uLXNwZWMtaWQCMBxpY2ViZXJnLnNjaGVtYcoreyJ0eXBlIjoic3RydWN0Iiwic2NoZW1hLWlkIjowLCJmaWVsZHMiOlt7ImlkIjowLCJuYW1lIjoic3RhdHVzIiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJpbnQifSx7ImlkIjoxLCJuYW1lIjoic25hcHNob3RfaWQiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOiJsb25nIn0seyJpZCI6MywibmFtZSI6InNlcXVlbmNlX251bWJlciIsInJlcXVpcmVkIjpmYWxzZSwidHlwZSI6ImxvbmcifSx7ImlkIjo0LCJuYW1lIjoiZmlsZV9zZXF1ZW5jZV9udW1iZXIiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOiJsb25nIn0seyJpZCI6MiwibmFtZSI6ImRhdGFfZmlsZSIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjp7InR5cGUiOiJzdHJ1Y3QiLCJmaWVsZHMiOlt7ImlkIjoxMzQsIm5hbWUiOiJjb250ZW50IiwicmVxdWlyZWQiOnRydWUsInR5cGUiOiJpbnQiLCJkb2MiOiJDb250ZW50cyBvZiB0aGUgZmlsZTogMD1kYXRhLCAxPXBvc2l0aW9uIGRlbGV0ZXMsIDI9ZXF1YWxpdHkgZGVsZXRlcyJ9LHsiaWQiOjEwMCwibmFtZSI6ImZpbGVfcGF0aCIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjoic3RyaW5nIiwiZG9jIjoiTG9jYXRpb24gVVJJIHdpdGggRlMgc2NoZW1lIn0seyJpZCI6MTAxLCJuYW1lIjoiZmlsZV9mb3JtYXQiLCJyZXF1aXJlZCI6dHJ1ZSwidHlwZSI6InN0cmluZyIsImRvYyI6IkZpbGUgZm9ybWF0IG5hbWU6IGF2cm8sIG9yYywgb3IgcGFycXVldCJ9LHsiaWQiOjEwMiwibmFtZSI6InBhcnRpdGlvbiIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjp7InR5cGUiOiJzdHJ1Y3QiLCJmaWVsZHMiOltdfSwiZG9jIjoiUGFydGl0aW9uIGRhdGEgdHVwbGUsIHNjaGVtYSBiYXNlZCBvbiB0aGUgcGFydGl0aW9uIHNwZWMifSx7ImlkIjoxMDMsIm5hbWUiOiJyZWNvcmRfY291bnQiLCJyZXF1aXJlZCI6dHJ1ZSwidHlwZSI6ImxvbmciLCJkb2MiOiJOdW1iZXIgb2YgcmVjb3JkcyBpbiB0aGUgZmlsZSJ9LHsiaWQiOjEwNCwibmFtZSI6ImZpbGVfc2l6ZV9pbl9ieXRlcyIsInJlcXVpcmVkIjp0cnVlLCJ0eXBlIjoibG9uZyIsImRvYyI6IlRvdGFsIGZpbGUgc2l6ZSBpbiBieXRlcyJ9LHsiaWQiOjEwOCwibmFtZSI6ImNvbHVtbl9zaXplcyIsInJlcXVpcmVkIjpmYWxzZSwidHlwZSI6eyJ0eXBlIjoibWFwIiwia2V5LWlkIjoxMTcsImtleSI6ImludCIsInZhbHVlLWlkIjoxMTgsInZhbHVlIjoibG9uZyIsInZhbHVlLXJlcXVpcmVkIjp0cnVlfSwiZG9jIjoiTWFwIG9mIGNvbHVtbiBpZCB0byB0b3RhbCBzaXplIG9uIGRpc2sifSx7ImlkIjoxMDksIm5hbWUiOiJ2YWx1ZV9jb3VudHMiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOnsidHlwZSI6Im1hcCIsImtleS1pZCI6MTE5LCJrZXkiOiJpbnQiLCJ2YWx1ZS1pZCI6MTIwLCJ2YWx1ZSI6ImxvbmciLCJ2YWx1ZS1yZXF1aXJlZCI6dHJ1ZX0sImRvYyI6Ik1hcCBvZiBjb2x1bW4gaWQgdG8gdG90YWwgY291bnQsIGluY2x1ZGluZyBudWxsIGFuZCBOYU4ifSx7ImlkIjoxMTAsIm5hbWUiOiJudWxsX3ZhbHVlX2NvdW50cyIsInJlcXVpcmVkIjpmYWxzZSwidHlwZSI6eyJ0eXBlIjoibWFwIiwia2V5LWlkIjoxMjEsImtleSI6ImludCIsInZhbHVlLWlkIjoxMjIsInZhbHVlIjoibG9uZyIsInZhbHVlLXJlcXVpcmVkIjp0cnVlfSwiZG9jIjoiTWFwIG9mIGNvbHVtbiBpZCB0byBudWxsIHZhbHVlIGNvdW50In0seyJpZCI6MTM3LCJuYW1lIjoibmFuX3ZhbHVlX2NvdW50cyIsInJlcXVpcmVkIjpmYWxzZSwidHlwZSI6eyJ0eXBlIjoibWFwIiwia2V5LWlkIjoxMzgsImtleSI6ImludCIsInZhbHVlLWlkIjoxMzksInZhbHVlIjoibG9uZyIsInZhbHVlLXJlcXVpcmVkIjp0cnVlfSwiZG9jIjoiTWFwIG9mIGNvbHVtbiBpZCB0byBudW1iZXIgb2YgTmFOIHZhbHVlcyBpbiB0aGUgY29sdW1uIn0seyJpZCI6MTI1LCJuYW1lIjoibG93ZXJfYm91bmRzIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjp7InR5cGUiOiJtYXAiLCJrZXktaWQiOjEyNiwia2V5IjoiaW50IiwidmFsdWUtaWQiOjEyNywidmFsdWUiOiJiaW5hcnkiLCJ2YWx1ZS1yZXF1aXJlZCI6dHJ1ZX0sImRvYyI6Ik1hcCBvZiBjb2x1bW4gaWQgdG8gbG93ZXIgYm91bmQifSx7ImlkIjoxMjgsIm5hbWUiOiJ1cHBlcl9ib3VuZHMiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOnsidHlwZSI6Im1hcCIsImtleS1pZCI6MTI5LCJrZXkiOiJpbnQiLCJ2YWx1ZS1pZCI6MTMwLCJ2YWx1ZSI6ImJpbmFyeSIsInZhbHVlLXJlcXVpcmVkIjp0cnVlfSwiZG9jIjoiTWFwIG9mIGNvbHVtbiBpZCB0byB1cHBlciBib3VuZCJ9LHsiaWQiOjEzMSwibmFtZSI6ImtleV9tZXRhZGF0YSIsInJlcXVpcmVkIjpmYWxzZSwidHlwZSI6ImJpbmFyeSIsImRvYyI6IkVuY3J5cHRpb24ga2V5IG1ldGFkYXRhIGJsb2IifSx7ImlkIjoxMzIsIm5hbWUiOiJzcGxpdF9vZmZzZXRzIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjp7InR5cGUiOiJsaXN0IiwiZWxlbWVudC1pZCI6MTMzLCJlbGVtZW50IjoibG9uZyIsImVsZW1lbnQtcmVxdWlyZWQiOnRydWV9LCJkb2MiOiJTcGxpdHRhYmxlIG9mZnNldHMifSx7ImlkIjoxMzUsIm5hbWUiOiJlcXVhbGl0eV9pZHMiLCJyZXF1aXJlZCI6ZmFsc2UsInR5cGUiOnsidHlwZSI6Imxpc3QiLCJlbGVtZW50LWlkIjoxMzYsImVsZW1lbnQiOiJpbnQiLCJlbGVtZW50LXJlcXVpcmVkIjp0cnVlfSwiZG9jIjoiRXF1YWxpdHkgY29tcGFyaXNvbiBmaWVsZCBJRHMifSx7ImlkIjoxNDAsIm5hbWUiOiJzb3J0X29yZGVyX2lkIiwicmVxdWlyZWQiOmZhbHNlLCJ0eXBlIjoiaW50IiwiZG9jIjoiU29ydCBvcmRlciBJRCJ9XX19XX0ccGFydGl0aW9uLXNwZWMEW10OY29udGVudAhkYXRhAEnkvCjWSpNuA0bpbRUz+dECrAM1jD1OAzEUhL2OCyrgIs56vfbaLlPQA4L66cU/gLQiYdc5AxIFR0BCUFFwAlqkvUjqXIE4IlN9o/k0lH6+PP9u33ffHxUh5IfWDz4u43AHATPWISbc9LnOccxwXMZHXI/3qwxDxDBK6FceezBeWtl5Aai0BmW0ABulgib5JJ1LxvhlfTgVJVy1PLguJCElF6oJXEnU3GrtOZrQWRFs26bEi9zM1zg8bWI+vVxcX91e3EzV6xll9GvG3mZkD1PFpqoAYYTQAufkP4w2h+6PnTm3d+hJEf8ASeS8KNZKk24DRultFTP50Q== | base64 --decode > /iceberg_data/default/test_iceberg_snapshot_reads2_local_7c2826c0_a455_4750_8e24_1fcf299f77cb/metadata/c010cab2-cd10-4e06-9d5d-642a92a59840-m0.avro] (cluster.py:121, run_and_check) 2025-05-23 21:10:57 [ 671 ] DEBUG : run container_id:rootteststorageiceberg-gw1-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p /iceberg_data/default/test_iceberg_snapshot_reads2_local_7c2826c0_a455_4750_8e24_1fcf299f77cb/metadata'] (cluster.py:2045, exec_in_container) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command:[docker exec rootteststorageiceberg-gw1-node1-1 bash -c mkdir -p /iceberg_data/default/test_iceberg_snapshot_reads2_local_7c2826c0_a455_4750_8e24_1fcf299f77cb/metadata] (cluster.py:121, run_and_check) 2025-05-23 21:10:57 [ 671 ] DEBUG : run container_id:rootteststorageiceberg-gw1-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname /iceberg_data/default/test_iceberg_snapshot_reads2_local_7c2826c0_a455_4750_8e24_1fcf299f77cb/metadata/version-hint.text) && echo MQ== | base64 --decode > /iceberg_data/default/test_iceberg_snapshot_reads2_local_7c2826c0_a455_4750_8e24_1fcf299f77cb/metadata/version-hint.text'] (cluster.py:2045, exec_in_container) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command:[docker exec rootteststorageiceberg-gw1-node1-1 bash -c mkdir -p $(dirname /iceberg_data/default/test_iceberg_snapshot_reads2_local_7c2826c0_a455_4750_8e24_1fcf299f77cb/metadata/version-hint.text) && echo MQ== | base64 --decode > /iceberg_data/default/test_iceberg_snapshot_reads2_local_7c2826c0_a455_4750_8e24_1fcf299f77cb/metadata/version-hint.text] (cluster.py:121, run_and_check) 2025-05-23 21:10:57 [ 671 ] DEBUG : run container_id:rootteststorageiceberg-gw1-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p /iceberg_data/default/test_iceberg_snapshot_reads2_local_7c2826c0_a455_4750_8e24_1fcf299f77cb/metadata'] (cluster.py:2045, exec_in_container) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command:[docker exec rootteststorageiceberg-gw1-node1-1 bash -c mkdir -p /iceberg_data/default/test_iceberg_snapshot_reads2_local_7c2826c0_a455_4750_8e24_1fcf299f77cb/metadata] (cluster.py:121, run_and_check) 2025-05-23 21:10:57 [ 671 ] DEBUG : run container_id:rootteststorageiceberg-gw1-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'mkdir -p $(dirname /iceberg_data/default/test_iceberg_snapshot_reads2_local_7c2826c0_a455_4750_8e24_1fcf299f77cb/metadata/v1.metadata.json) && echo ewogICJmb3JtYXQtdmVyc2lvbiIgOiAyLAogICJ0YWJsZS11dWlkIiA6ICJmYzU5ODg1ZS02ZjgwLTQ4N2YtODZjMS0zZjU5ZmVjMTIxYzgiLAogICJsb2NhdGlvbiIgOiAiL2ljZWJlcmdfZGF0YS9kZWZhdWx0L3Rlc3RfaWNlYmVyZ19zbmFwc2hvdF9yZWFkczJfbG9jYWxfN2MyODI2YzBfYTQ1NV80NzUwXzhlMjRfMWZjZjI5OWY3N2NiIiwKICAibGFzdC1zZXF1ZW5jZS1udW1iZXIiIDogMSwKICAibGFzdC11cGRhdGVkLW1zIiA6IDE3NDgwMzQ2NTcwMzMsCiAgImxhc3QtY29sdW1uLWlkIiA6IDIsCiAgImN1cnJlbnQtc2NoZW1hLWlkIiA6IDAsCiAgInNjaGVtYXMiIDogWyB7CiAgICAidHlwZSIgOiAic3RydWN0IiwKICAgICJzY2hlbWEtaWQiIDogMCwKICAgICJmaWVsZHMiIDogWyB7CiAgICAgICJpZCIgOiAxLAogICAgICAibmFtZSIgOiAiYSIsCiAgICAgICJyZXF1aXJlZCIgOiBmYWxzZSwKICAgICAgInR5cGUiIDogImxvbmciCiAgICB9LCB7CiAgICAgICJpZCIgOiAyLAogICAgICAibmFtZSIgOiAiYiIsCiAgICAgICJyZXF1aXJlZCIgOiBmYWxzZSwKICAgICAgInR5cGUiIDogInN0cmluZyIKICAgIH0gXQogIH0gXSwKICAiZGVmYXVsdC1zcGVjLWlkIiA6IDAsCiAgInBhcnRpdGlvbi1zcGVjcyIgOiBbIHsKICAgICJzcGVjLWlkIiA6IDAsCiAgICAiZmllbGRzIiA6IFsgXQogIH0gXSwKICAibGFzdC1wYXJ0aXRpb24taWQiIDogOTk5LAogICJkZWZhdWx0LXNvcnQtb3JkZXItaWQiIDogMCwKICAic29ydC1vcmRlcnMiIDogWyB7CiAgICAib3JkZXItaWQiIDogMCwKICAgICJmaWVsZHMiIDogWyBdCiAgfSBdLAogICJwcm9wZXJ0aWVzIiA6IHsKICAgICJvd25lciIgOiAicm9vdCIKICB9LAogICJjdXJyZW50LXNuYXBzaG90LWlkIiA6IDU4ODU4ODY0MzUxNjUyNjY1NzgsCiAgInJlZnMiIDogewogICAgIm1haW4iIDogewogICAgICAic25hcHNob3QtaWQiIDogNTg4NTg4NjQzNTE2NTI2NjU3OCwKICAgICAgInR5cGUiIDogImJyYW5jaCIKICAgIH0KICB9LAogICJzbmFwc2hvdHMiIDogWyB7CiAgICAic2VxdWVuY2UtbnVtYmVyIiA6IDEsCiAgICAic25hcHNob3QtaWQiIDogNTg4NTg4NjQzNTE2NTI2NjU3OCwKICAgICJ0aW1lc3RhbXAtbXMiIDogMTc0ODAzNDY1NzAzMywKICAgICJzdW1tYXJ5IiA6IHsKICAgICAgIm9wZXJhdGlvbiIgOiAiYXBwZW5kIiwKICAgICAgInNwYXJrLmFwcC5pZCIgOiAibG9jYWwtMTc0ODAzNDYzNjQzMiIsCiAgICAgICJhZGRlZC1kYXRhLWZpbGVzIiA6ICIxIiwKICAgICAgImFkZGVkLXJlY29yZHMiIDogIjEwMCIsCiAgICAgICJhZGRlZC1maWxlcy1zaXplIiA6ICI5NjciLAogICAgICAiY2hhbmdlZC1wYXJ0aXRpb24tY291bnQiIDogIjEiLAogICAgICAidG90YWwtcmVjb3JkcyIgOiAiMTAwIiwKICAgICAgInRvdGFsLWZpbGVzLXNpemUiIDogIjk2NyIsCiAgICAgICJ0b3RhbC1kYXRhLWZpbGVzIiA6ICIxIiwKICAgICAgInRvdGFsLWRlbGV0ZS1maWxlcyIgOiAiMCIsCiAgICAgICJ0b3RhbC1wb3NpdGlvbi1kZWxldGVzIiA6ICIwIiwKICAgICAgInRvdGFsLWVxdWFsaXR5LWRlbGV0ZXMiIDogIjAiCiAgICB9LAogICAgIm1hbmlmZXN0LWxpc3QiIDogIi9pY2ViZXJnX2RhdGEvZGVmYXVsdC90ZXN0X2ljZWJlcmdfc25hcHNob3RfcmVhZHMyX2xvY2FsXzdjMjgyNmMwX2E0NTVfNDc1MF84ZTI0XzFmY2YyOTlmNzdjYi9tZXRhZGF0YS9zbmFwLTU4ODU4ODY0MzUxNjUyNjY1NzgtMS1jMDEwY2FiMi1jZDEwLTRlMDYtOWQ1ZC02NDJhOTJhNTk4NDAuYXZybyIsCiAgICAic2NoZW1hLWlkIiA6IDAKICB9IF0sCiAgInN0YXRpc3RpY3MiIDogWyBdLAogICJzbmFwc2hvdC1sb2ciIDogWyB7CiAgICAidGltZXN0YW1wLW1zIiA6IDE3NDgwMzQ2NTcwMzMsCiAgICAic25hcHNob3QtaWQiIDogNTg4NTg4NjQzNTE2NTI2NjU3OAogIH0gXSwKICAibWV0YWRhdGEtbG9nIiA6IFsgXQp9 | base64 --decode > /iceberg_data/default/test_iceberg_snapshot_reads2_local_7c2826c0_a455_4750_8e24_1fcf299f77cb/metadata/v1.metadata.json'] (cluster.py:2045, exec_in_container) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command:[docker exec rootteststorageiceberg-gw1-node1-1 bash -c mkdir -p $(dirname /iceberg_data/default/test_iceberg_snapshot_reads2_local_7c2826c0_a455_4750_8e24_1fcf299f77cb/metadata/v1.metadata.json) && echo ewogICJmb3JtYXQtdmVyc2lvbiIgOiAyLAogICJ0YWJsZS11dWlkIiA6ICJmYzU5ODg1ZS02ZjgwLTQ4N2YtODZjMS0zZjU5ZmVjMTIxYzgiLAogICJsb2NhdGlvbiIgOiAiL2ljZWJlcmdfZGF0YS9kZWZhdWx0L3Rlc3RfaWNlYmVyZ19zbmFwc2hvdF9yZWFkczJfbG9jYWxfN2MyODI2YzBfYTQ1NV80NzUwXzhlMjRfMWZjZjI5OWY3N2NiIiwKICAibGFzdC1zZXF1ZW5jZS1udW1iZXIiIDogMSwKICAibGFzdC11cGRhdGVkLW1zIiA6IDE3NDgwMzQ2NTcwMzMsCiAgImxhc3QtY29sdW1uLWlkIiA6IDIsCiAgImN1cnJlbnQtc2NoZW1hLWlkIiA6IDAsCiAgInNjaGVtYXMiIDogWyB7CiAgICAidHlwZSIgOiAic3RydWN0IiwKICAgICJzY2hlbWEtaWQiIDogMCwKICAgICJmaWVsZHMiIDogWyB7CiAgICAgICJpZCIgOiAxLAogICAgICAibmFtZSIgOiAiYSIsCiAgICAgICJyZXF1aXJlZCIgOiBmYWxzZSwKICAgICAgInR5cGUiIDogImxvbmciCiAgICB9LCB7CiAgICAgICJpZCIgOiAyLAogICAgICAibmFtZSIgOiAiYiIsCiAgICAgICJyZXF1aXJlZCIgOiBmYWxzZSwKICAgICAgInR5cGUiIDogInN0cmluZyIKICAgIH0gXQogIH0gXSwKICAiZGVmYXVsdC1zcGVjLWlkIiA6IDAsCiAgInBhcnRpdGlvbi1zcGVjcyIgOiBbIHsKICAgICJzcGVjLWlkIiA6IDAsCiAgICAiZmllbGRzIiA6IFsgXQogIH0gXSwKICAibGFzdC1wYXJ0aXRpb24taWQiIDogOTk5LAogICJkZWZhdWx0LXNvcnQtb3JkZXItaWQiIDogMCwKICAic29ydC1vcmRlcnMiIDogWyB7CiAgICAib3JkZXItaWQiIDogMCwKICAgICJmaWVsZHMiIDogWyBdCiAgfSBdLAogICJwcm9wZXJ0aWVzIiA6IHsKICAgICJvd25lciIgOiAicm9vdCIKICB9LAogICJjdXJyZW50LXNuYXBzaG90LWlkIiA6IDU4ODU4ODY0MzUxNjUyNjY1NzgsCiAgInJlZnMiIDogewogICAgIm1haW4iIDogewogICAgICAic25hcHNob3QtaWQiIDogNTg4NTg4NjQzNTE2NTI2NjU3OCwKICAgICAgInR5cGUiIDogImJyYW5jaCIKICAgIH0KICB9LAogICJzbmFwc2hvdHMiIDogWyB7CiAgICAic2VxdWVuY2UtbnVtYmVyIiA6IDEsCiAgICAic25hcHNob3QtaWQiIDogNTg4NTg4NjQzNTE2NTI2NjU3OCwKICAgICJ0aW1lc3RhbXAtbXMiIDogMTc0ODAzNDY1NzAzMywKICAgICJzdW1tYXJ5IiA6IHsKICAgICAgIm9wZXJhdGlvbiIgOiAiYXBwZW5kIiwKICAgICAgInNwYXJrLmFwcC5pZCIgOiAibG9jYWwtMTc0ODAzNDYzNjQzMiIsCiAgICAgICJhZGRlZC1kYXRhLWZpbGVzIiA6ICIxIiwKICAgICAgImFkZGVkLXJlY29yZHMiIDogIjEwMCIsCiAgICAgICJhZGRlZC1maWxlcy1zaXplIiA6ICI5NjciLAogICAgICAiY2hhbmdlZC1wYXJ0aXRpb24tY291bnQiIDogIjEiLAogICAgICAidG90YWwtcmVjb3JkcyIgOiAiMTAwIiwKICAgICAgInRvdGFsLWZpbGVzLXNpemUiIDogIjk2NyIsCiAgICAgICJ0b3RhbC1kYXRhLWZpbGVzIiA6ICIxIiwKICAgICAgInRvdGFsLWRlbGV0ZS1maWxlcyIgOiAiMCIsCiAgICAgICJ0b3RhbC1wb3NpdGlvbi1kZWxldGVzIiA6ICIwIiwKICAgICAgInRvdGFsLWVxdWFsaXR5LWRlbGV0ZXMiIDogIjAiCiAgICB9LAogICAgIm1hbmlmZXN0LWxpc3QiIDogIi9pY2ViZXJnX2RhdGEvZGVmYXVsdC90ZXN0X2ljZWJlcmdfc25hcHNob3RfcmVhZHMyX2xvY2FsXzdjMjgyNmMwX2E0NTVfNDc1MF84ZTI0XzFmY2YyOTlmNzdjYi9tZXRhZGF0YS9zbmFwLTU4ODU4ODY0MzUxNjUyNjY1NzgtMS1jMDEwY2FiMi1jZDEwLTRlMDYtOWQ1ZC02NDJhOTJhNTk4NDAuYXZybyIsCiAgICAic2NoZW1hLWlkIiA6IDAKICB9IF0sCiAgInN0YXRpc3RpY3MiIDogWyBdLAogICJzbmFwc2hvdC1sb2ciIDogWyB7CiAgICAidGltZXN0YW1wLW1zIiA6IDE3NDgwMzQ2NTcwMzMsCiAgICAic25hcHNob3QtaWQiIDogNTg4NTg4NjQzNTE2NTI2NjU3OAogIH0gXSwKICAibWV0YWRhdGEtbG9nIiA6IFsgXQp9 | base64 --decode > /iceberg_data/default/test_iceberg_snapshot_reads2_local_7c2826c0_a455_4750_8e24_1fcf299f77cb/metadata/v1.metadata.json] (cluster.py:121, run_and_check) 2025-05-23 21:10:57 [ 671 ] DEBUG : Executing query DROP TABLE IF EXISTS test_iceberg_snapshot_reads2_local_7c2826c0_a455_4750_8e24_1fcf299f77cb SYNC on node1 (cluster.py:3570, query) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: m d o883 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: m d o882 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: m d o888 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: m d o893 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: m d o901 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: m d o907 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: m d o914 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: m d o919 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: m d o886 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: m d o887 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: m d o889 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: m d o890 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: m d o891 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: m d o892 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: m d o894 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: m d o895 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: m d o896 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: m d o897 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: m d o898 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: m d o900 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: m d o902 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: m d o903 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: m d o904 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: m d o905 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: m d o906 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: m d o908 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: m d o909 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: m d o910 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: m d o911 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: m d o912 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: m d o913 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: m d o915 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: m d o916 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: m d o917 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: m d o918 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: m d o920 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: m d o921 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: m d o924 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: m d o925 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Executing query DROP TABLE IF EXISTS test_iceberg_snapshot_reads2_local_7c2826c0_a455_4750_8e24_1fcf299f77cb; CREATE TABLE test_iceberg_snapshot_reads2_local_7c2826c0_a455_4750_8e24_1fcf299f77cb ENGINE=IcebergLocal(local, path = '/iceberg_data/default/test_iceberg_snapshot_reads2_local_7c2826c0_a455_4750_8e24_1fcf299f77cb/', format=Parquet) on node1 (cluster.py:3570, query) 2025-05-23 21:10:57 [ 671 ] DEBUG : Executing query SELECT count() FROM test_iceberg_snapshot_reads2_local_7c2826c0_a455_4750_8e24_1fcf299f77cb on node1 (cluster.py:3570, query) ______________________ test_iceberg_snapshot_reads[s3-1] _______________________ [gw1] linux -- Python 3.10.12 /usr/bin/python3 started_cluster = format_version = '1', storage_type = 's3' @pytest.mark.parametrize("format_version", ["1", "2"]) @pytest.mark.parametrize("storage_type", ["s3", "azure", "local"]) def test_iceberg_snapshot_reads(started_cluster, format_version, storage_type): instance = started_cluster.instances["node1"] spark = started_cluster.spark_session TABLE_NAME = ( "test_iceberg_snapshot_reads" + format_version + "_" + storage_type + "_" + get_uuid_str() ) write_iceberg_from_df( spark, generate_data(spark, 0, 100), TABLE_NAME, mode="overwrite", format_version=format_version, ) default_upload_directory( started_cluster, storage_type, f"/iceberg_data/default/{TABLE_NAME}/", "", ) create_iceberg_table(storage_type, instance, TABLE_NAME, started_cluster) assert int(instance.query(f"SELECT count() FROM {TABLE_NAME}")) == 100 snapshot1_timestamp = datetime.now(timezone.utc) snapshot1_id = get_last_snapshot(f"/iceberg_data/default/{TABLE_NAME}/") > time.sleep(0.1) E NameError: name 'time' is not defined test_storage_iceberg/test.py:2568: NameError ----------------------------- Captured stdout call ----------------------------- 25/05/23 21:10:57 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:57 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:57 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:57 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:57 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:57 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. {} {} {} Upload to bucket: None {} Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None {'format-version': 1, 'table-uuid': 'c675e487-d6d2-42af-8eab-56a3bf39c07f', 'location': '/iceberg_data/default/test_iceberg_snapshot_reads1_s3_728b155b_868d_4baa_9496_6b67619e3160', 'last-updated-ms': 1748034657930, 'last-column-id': 2, 'schema': {'type': 'struct', 'schema-id': 0, 'fields': [{'id': 1, 'name': 'a', 'required': False, 'type': 'long'}, {'id': 2, 'name': 'b', 'required': False, 'type': 'string'}]}, 'current-schema-id': 0, 'schemas': [{'type': 'struct', 'schema-id': 0, 'fields': [{'id': 1, 'name': 'a', 'required': False, 'type': 'long'}, {'id': 2, 'name': 'b', 'required': False, 'type': 'string'}]}], 'partition-spec': [], 'default-spec-id': 0, 'partition-specs': [{'spec-id': 0, 'fields': []}], 'last-partition-id': 999, 'default-sort-order-id': 0, 'sort-orders': [{'order-id': 0, 'fields': []}], 'properties': {'owner': 'root'}, 'current-snapshot-id': 4313643897586673497, 'refs': {'main': {'snapshot-id': 4313643897586673497, 'type': 'branch'}}, 'snapshots': [{'snapshot-id': 4313643897586673497, 'timestamp-ms': 1748034657930, 'summary': {'operation': 'append', 'spark.app.id': 'local-1748034636432', 'added-data-files': '1', 'added-records': '100', 'added-files-size': '967', 'changed-partition-count': '1', 'total-records': '100', 'total-files-size': '967', 'total-data-files': '1', 'total-delete-files': '0', 'total-position-deletes': '0', 'total-equality-deletes': '0'}, 'manifest-list': '/iceberg_data/default/test_iceberg_snapshot_reads1_s3_728b155b_868d_4baa_9496_6b67619e3160/metadata/snap-4313643897586673497-1-f61cbd91-d11b-458d-bbe3-03531aeaa059.avro', 'schema-id': 0}], 'statistics': [], 'snapshot-log': [{'timestamp-ms': 1748034657930, 'snapshot-id': 4313643897586673497}], 'metadata-log': []} ------------------------------ Captured log call ------------------------------- 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yro926 (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: c o926 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: c o61 range i0 i100 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yro927 (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !ylo928 (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: c o928 add sa e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro928 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yro929 (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: c o927 toDF ro929 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yro930 (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yro931 (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: c o931 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: c o61 range i1 i101 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yro932 (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !ylo933 (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: c o933 add sb e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro933 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yro934 (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: c o932 toDF ro934 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yro935 (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: c o935 apply sb e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yro936 (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yro937 (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: c o937 isDefined e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yro938 (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: c o938 get e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yro939 (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yro940 (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yao941 (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: c o940 applyModifiableSettings ro939 ro941 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: c o61 parseDataType s"string" e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yro942 (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: c o936 cast ro942 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yro943 (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: c o935 withColumn sb ro943 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yro944 (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yro945 (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yro946 (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !ylo947 (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: c o947 add ro946 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro947 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yro948 (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro948 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yro949 (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: c o945 over ro949 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yro950 (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: c o930 withColumn srow_index ro950 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yro951 (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yro952 (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yro953 (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !ylo954 (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: c o954 add ro953 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro954 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yro955 (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro955 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yro956 (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: c o952 over ro956 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yro957 (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: c o944 withColumn srow_index ro957 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yro958 (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !ylo959 (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: c o959 add srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro959 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yro960 (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: c o951 join ro958 ro960 sinner e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yro961 (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: c o961 drop srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yro962 (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: c o962 writeTo stest_iceberg_snapshot_reads1_s3_728b155b_868d_4baa_9496_6b67619e3160 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yro963 (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: c o963 tableProperty sformat-version s1 e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yro964 (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: c o963 using siceberg e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yro965 (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Command to send: c o963 create e (clientserver.py:501, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:57 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_snapshot_reads1_s3_728b155b_868d_4baa_9496_6b67619e3160/data/00000-45-6d796b95-65f1-4515-a16c-6244375f3cb2-00001.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:57 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_snapshot_reads1_s3_728b155b_868d_4baa_9496_6b67619e3160/metadata/snap-4313643897586673497-1-f61cbd91-d11b-458d-bbe3-03531aeaa059.avro HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:57 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_snapshot_reads1_s3_728b155b_868d_4baa_9496_6b67619e3160/metadata/version-hint.text HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:57 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_snapshot_reads1_s3_728b155b_868d_4baa_9496_6b67619e3160/metadata/v1.metadata.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:57 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_snapshot_reads1_s3_728b155b_868d_4baa_9496_6b67619e3160/metadata/f61cbd91-d11b-458d-bbe3-03531aeaa059-m0.avro HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:57 [ 671 ] DEBUG : Executing query DROP TABLE IF EXISTS test_iceberg_snapshot_reads1_s3_728b155b_868d_4baa_9496_6b67619e3160 SYNC on node1 (cluster.py:3570, query) 2025-05-23 21:10:58 [ 671 ] DEBUG : Executing query DROP TABLE IF EXISTS test_iceberg_snapshot_reads1_s3_728b155b_868d_4baa_9496_6b67619e3160; CREATE TABLE test_iceberg_snapshot_reads1_s3_728b155b_868d_4baa_9496_6b67619e3160 ENGINE=IcebergS3(s3, filename = 'iceberg_data/default/test_iceberg_snapshot_reads1_s3_728b155b_868d_4baa_9496_6b67619e3160/', format=Parquet, url = 'http://minio1:9001/root/') on node1 (cluster.py:3570, query) 2025-05-23 21:10:58 [ 671 ] DEBUG : Executing query SELECT count() FROM test_iceberg_snapshot_reads1_s3_728b155b_868d_4baa_9496_6b67619e3160 on node1 (cluster.py:3570, query) ______________________ test_iceberg_snapshot_reads[s3-2] _______________________ [gw1] linux -- Python 3.10.12 /usr/bin/python3 started_cluster = format_version = '2', storage_type = 's3' @pytest.mark.parametrize("format_version", ["1", "2"]) @pytest.mark.parametrize("storage_type", ["s3", "azure", "local"]) def test_iceberg_snapshot_reads(started_cluster, format_version, storage_type): instance = started_cluster.instances["node1"] spark = started_cluster.spark_session TABLE_NAME = ( "test_iceberg_snapshot_reads" + format_version + "_" + storage_type + "_" + get_uuid_str() ) write_iceberg_from_df( spark, generate_data(spark, 0, 100), TABLE_NAME, mode="overwrite", format_version=format_version, ) default_upload_directory( started_cluster, storage_type, f"/iceberg_data/default/{TABLE_NAME}/", "", ) create_iceberg_table(storage_type, instance, TABLE_NAME, started_cluster) assert int(instance.query(f"SELECT count() FROM {TABLE_NAME}")) == 100 snapshot1_timestamp = datetime.now(timezone.utc) snapshot1_id = get_last_snapshot(f"/iceberg_data/default/{TABLE_NAME}/") > time.sleep(0.1) E NameError: name 'time' is not defined test_storage_iceberg/test.py:2568: NameError ----------------------------- Captured stdout call ----------------------------- 25/05/23 21:10:58 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:58 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:58 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:58 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:58 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:58 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. {} {} {} Upload to bucket: None {} Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None {'format-version': 2, 'table-uuid': '9f26fe55-4af5-4d72-adec-9c571b1e988d', 'location': '/iceberg_data/default/test_iceberg_snapshot_reads2_s3_7803892c_681f_44ef_8227_0bbec59596f1', 'last-sequence-number': 1, 'last-updated-ms': 1748034658497, 'last-column-id': 2, 'current-schema-id': 0, 'schemas': [{'type': 'struct', 'schema-id': 0, 'fields': [{'id': 1, 'name': 'a', 'required': False, 'type': 'long'}, {'id': 2, 'name': 'b', 'required': False, 'type': 'string'}]}], 'default-spec-id': 0, 'partition-specs': [{'spec-id': 0, 'fields': []}], 'last-partition-id': 999, 'default-sort-order-id': 0, 'sort-orders': [{'order-id': 0, 'fields': []}], 'properties': {'owner': 'root'}, 'current-snapshot-id': 906877821178827258, 'refs': {'main': {'snapshot-id': 906877821178827258, 'type': 'branch'}}, 'snapshots': [{'sequence-number': 1, 'snapshot-id': 906877821178827258, 'timestamp-ms': 1748034658497, 'summary': {'operation': 'append', 'spark.app.id': 'local-1748034636432', 'added-data-files': '1', 'added-records': '100', 'added-files-size': '967', 'changed-partition-count': '1', 'total-records': '100', 'total-files-size': '967', 'total-data-files': '1', 'total-delete-files': '0', 'total-position-deletes': '0', 'total-equality-deletes': '0'}, 'manifest-list': '/iceberg_data/default/test_iceberg_snapshot_reads2_s3_7803892c_681f_44ef_8227_0bbec59596f1/metadata/snap-906877821178827258-1-0695a7d2-875d-4245-aa00-deef6564f8c9.avro', 'schema-id': 0}], 'statistics': [], 'snapshot-log': [{'timestamp-ms': 1748034658497, 'snapshot-id': 906877821178827258}], 'metadata-log': []} ------------------------------ Captured log call ------------------------------- 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro966 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o966 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o61 range i0 i100 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro967 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ylo968 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o968 add sa e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro968 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro969 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o967 toDF ro969 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro970 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro971 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o971 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o61 range i1 i101 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro972 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ylo973 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o973 add sb e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro973 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro974 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o972 toDF ro974 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro975 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o975 apply sb e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro976 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro977 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o977 isDefined e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro978 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o978 get e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro979 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro980 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yao981 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o980 applyModifiableSettings ro979 ro981 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o61 parseDataType s"string" e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro982 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o976 cast ro982 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro983 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o975 withColumn sb ro983 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro984 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro985 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro986 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ylo987 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o987 add ro986 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro987 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro988 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro988 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro989 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o985 over ro989 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro990 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o970 withColumn srow_index ro990 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro991 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro992 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro993 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ylo994 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o994 add ro993 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro994 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro995 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro995 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro996 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o992 over ro996 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro997 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o984 withColumn srow_index ro997 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro998 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ylo999 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o999 add srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro999 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro1000 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o991 join ro998 ro1000 sinner e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro1001 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o1001 drop srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro1002 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o1002 writeTo stest_iceberg_snapshot_reads2_s3_7803892c_681f_44ef_8227_0bbec59596f1 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro1003 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o1003 tableProperty sformat-version s2 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro1004 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o1003 using siceberg e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro1005 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o1003 create e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_snapshot_reads2_s3_7803892c_681f_44ef_8227_0bbec59596f1/data/00000-47-79682eb9-a7a8-4320-ada9-73b8d7fdb4ff-00001.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o923 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o922 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o928 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o933 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o941 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o947 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o954 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o959 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o926 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o927 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o929 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o930 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o931 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o932 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o934 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o935 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_snapshot_reads2_s3_7803892c_681f_44ef_8227_0bbec59596f1/metadata/0695a7d2-875d-4245-aa00-deef6564f8c9-m0.avro HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o936 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o937 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o938 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o940 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o942 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o943 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o944 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o945 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o946 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o948 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_snapshot_reads2_s3_7803892c_681f_44ef_8227_0bbec59596f1/metadata/snap-906877821178827258-1-0695a7d2-875d-4245-aa00-deef6564f8c9.avro HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o949 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o950 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o951 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o952 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o953 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o955 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_snapshot_reads2_s3_7803892c_681f_44ef_8227_0bbec59596f1/metadata/version-hint.text HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o956 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o957 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o958 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o960 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o961 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o964 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o965 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o963 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o962 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o779 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o819 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o859 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o899 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_iceberg_snapshot_reads2_s3_7803892c_681f_44ef_8227_0bbec59596f1/metadata/v1.metadata.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:58 [ 671 ] DEBUG : Executing query DROP TABLE IF EXISTS test_iceberg_snapshot_reads2_s3_7803892c_681f_44ef_8227_0bbec59596f1 SYNC on node1 (cluster.py:3570, query) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o968 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o973 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o981 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o987 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o994 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o999 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o966 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o967 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o969 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o970 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o971 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o972 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o974 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o975 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o976 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o977 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o978 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o980 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o982 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o983 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o984 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o985 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o986 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o988 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o989 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o990 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o992 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o993 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o995 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o996 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o997 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o1004 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: m d o1005 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Executing query DROP TABLE IF EXISTS test_iceberg_snapshot_reads2_s3_7803892c_681f_44ef_8227_0bbec59596f1; CREATE TABLE test_iceberg_snapshot_reads2_s3_7803892c_681f_44ef_8227_0bbec59596f1 ENGINE=IcebergS3(s3, filename = 'iceberg_data/default/test_iceberg_snapshot_reads2_s3_7803892c_681f_44ef_8227_0bbec59596f1/', format=Parquet, url = 'http://minio1:9001/root/') on node1 (cluster.py:3570, query) 2025-05-23 21:10:58 [ 671 ] DEBUG : Executing query SELECT count() FROM test_iceberg_snapshot_reads2_s3_7803892c_681f_44ef_8227_0bbec59596f1 on node1 (cluster.py:3570, query) __________________________ test_metadata_cache[azure] __________________________ [gw1] linux -- Python 3.10.12 /usr/bin/python3 started_cluster = storage_type = 'azure' @pytest.mark.parametrize("storage_type", ["s3", "azure"]) def test_metadata_cache(started_cluster, storage_type): instance = started_cluster.instances["node1"] spark = started_cluster.spark_session TABLE_NAME = "test_metadata_cache_" + storage_type + "_" + get_uuid_str() write_iceberg_from_df( spark, generate_data(spark, 0, 10), TABLE_NAME, mode="overwrite", format_version="1", partition_by="a", ) default_upload_directory( started_cluster, storage_type, f"/iceberg_data/default/{TABLE_NAME}/", f"/iceberg_data/default/{TABLE_NAME}/", ) table_expr = get_creation_expression(storage_type, TABLE_NAME, started_cluster, table_function=True) query_id = f"{TABLE_NAME}-{uuid.uuid4()}" instance.query( f"SELECT * FROM {table_expr}", query_id=query_id, ) instance.query("SYSTEM FLUSH LOGS") > assert 0 < int( instance.query( f"SELECT ProfileEvents['IcebergMetadataFilesCacheMisses'] FROM system.query_log WHERE query_id = '{query_id}' AND type = 'QueryFinish'" ) ) E assert 0 < 0 E + where 0 = int('0\n') E + where '0\n' = >("SELECT ProfileEvents['IcebergMetadataFilesCacheMisses'] FROM system.query_log WHERE query_id = 'test_metadata_cache_azure_650f0bcb_5f84_4857_8223_8278519c86f8-243c9300-895f-4374-9d58-d62fe05bd046' AND type = 'QueryFinish'") E + where > = .query test_storage_iceberg/test.py:2695: AssertionError ----------------------------- Captured stdout call ----------------------------- 25/05/23 21:10:58 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:58 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:58 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:58 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:58 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:58 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. {} {} {} {} {} {} {} {} {} {} {} {} {} ------------------------------ Captured log call ------------------------------- 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro1006 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o1006 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o61 range i0 i10 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro1007 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ylo1008 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o1008 add sa e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1008 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro1009 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o1007 toDF ro1009 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro1010 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro1011 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o1011 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o61 range i1 i11 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro1012 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ylo1013 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o1013 add sb e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1013 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro1014 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o1012 toDF ro1014 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro1015 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o1015 apply sb e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro1016 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro1017 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o1017 isDefined e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro1018 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o1018 get e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro1019 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro1020 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yao1021 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o1020 applyModifiableSettings ro1019 ro1021 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o61 parseDataType s"string" e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro1022 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o1016 cast ro1022 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro1023 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o1015 withColumn sb ro1023 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro1024 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro1025 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro1026 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ylo1027 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o1027 add ro1026 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1027 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro1028 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1028 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro1029 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o1025 over ro1029 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro1030 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o1010 withColumn srow_index ro1030 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro1031 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro1032 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro1033 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ylo1034 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o1034 add ro1033 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1034 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro1035 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1035 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro1036 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o1032 over ro1036 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro1037 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o1024 withColumn srow_index ro1037 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro1038 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ylo1039 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o1039 add srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1039 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro1040 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o1031 join ro1038 ro1040 sinner e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro1041 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o1041 drop srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro1042 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o1042 writeTo stest_metadata_cache_azure_650f0bcb_5f84_4857_8223_8278519c86f8 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro1043 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o1043 tableProperty sformat-version s1 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro1044 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions col e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions col sa e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro1045 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !ylo1046 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1046 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro1047 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o1043 partitionedBy ro1045 ro1047 e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro1048 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o1043 using siceberg e (clientserver.py:501, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Answer received: !yro1049 (clientserver.py:512, send_command) 2025-05-23 21:10:58 [ 671 ] DEBUG : Command to send: c o1043 create e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_metadata_cache_azure_650f0bcb_5f84_4857_8223_8278519c86f8/data/a%3D4/00000-49-dbe77ec2-acb7-43af-bb56-0aaab223119e-00005.parquet' Request method: 'PUT' Request headers: 'Content-Length': '630' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '6ca6ac6a-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:59 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_metadata_cache_azure_650f0bcb_5f84_4857_8223_8278519c86f8/data/a%3D4/00000-49-dbe77ec2-acb7-43af-bb56-0aaab223119e-00005.parquet HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:59 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x1F32FFC466F55E0"' 'last-modified': 'Fri, 23 May 2025 21:10:59 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '6ca6ac6a-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '184cb953-d071-4dc8-a5f3-61cb990eb536' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:59 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:59 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_metadata_cache_azure_650f0bcb_5f84_4857_8223_8278519c86f8/data/a%3D5/00000-49-dbe77ec2-acb7-43af-bb56-0aaab223119e-00006.parquet' Request method: 'PUT' Request headers: 'Content-Length': '631' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '6ca81fdc-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:59 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_metadata_cache_azure_650f0bcb_5f84_4857_8223_8278519c86f8/data/a%3D5/00000-49-dbe77ec2-acb7-43af-bb56-0aaab223119e-00006.parquet HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:59 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x1BAEA8D34290C60"' 'last-modified': 'Fri, 23 May 2025 21:10:59 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '6ca81fdc-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': 'f62f2fc5-52dc-40fe-a0e9-1023e6a02c0e' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:59 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:59 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_metadata_cache_azure_650f0bcb_5f84_4857_8223_8278519c86f8/data/a%3D6/00000-49-dbe77ec2-acb7-43af-bb56-0aaab223119e-00007.parquet' Request method: 'PUT' Request headers: 'Content-Length': '631' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '6ca9439e-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:59 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_metadata_cache_azure_650f0bcb_5f84_4857_8223_8278519c86f8/data/a%3D6/00000-49-dbe77ec2-acb7-43af-bb56-0aaab223119e-00007.parquet HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:59 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x1DBDE2E2A2729E0"' 'last-modified': 'Fri, 23 May 2025 21:10:59 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '6ca9439e-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '4c701411-5159-4559-ae90-c4db38e74891' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:59 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:59 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_metadata_cache_azure_650f0bcb_5f84_4857_8223_8278519c86f8/data/a%3D3/00000-49-dbe77ec2-acb7-43af-bb56-0aaab223119e-00004.parquet' Request method: 'PUT' Request headers: 'Content-Length': '631' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '6caa5dd8-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:59 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_metadata_cache_azure_650f0bcb_5f84_4857_8223_8278519c86f8/data/a%3D3/00000-49-dbe77ec2-acb7-43af-bb56-0aaab223119e-00004.parquet HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:59 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x26CEEFA8AD8E700"' 'last-modified': 'Fri, 23 May 2025 21:10:59 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '6caa5dd8-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': 'e72b43d6-f9f7-43ea-afcf-6aadaaa76869' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:59 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:59 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_metadata_cache_azure_650f0bcb_5f84_4857_8223_8278519c86f8/data/a%3D1/00000-49-dbe77ec2-acb7-43af-bb56-0aaab223119e-00002.parquet' Request method: 'PUT' Request headers: 'Content-Length': '631' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '6cab6250-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:59 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_metadata_cache_azure_650f0bcb_5f84_4857_8223_8278519c86f8/data/a%3D1/00000-49-dbe77ec2-acb7-43af-bb56-0aaab223119e-00002.parquet HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:59 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x1E96E5D81465350"' 'last-modified': 'Fri, 23 May 2025 21:10:59 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '6cab6250-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': 'cd7730bd-d1ba-4ded-b08e-cd282c7bb1e8' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:59 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:59 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_metadata_cache_azure_650f0bcb_5f84_4857_8223_8278519c86f8/data/a%3D8/00000-49-dbe77ec2-acb7-43af-bb56-0aaab223119e-00009.parquet' Request method: 'PUT' Request headers: 'Content-Length': '631' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '6cac6bc8-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:59 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_metadata_cache_azure_650f0bcb_5f84_4857_8223_8278519c86f8/data/a%3D8/00000-49-dbe77ec2-acb7-43af-bb56-0aaab223119e-00009.parquet HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:59 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x2675CE719744740"' 'last-modified': 'Fri, 23 May 2025 21:10:59 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '6cac6bc8-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '79d7cb6f-f015-4c42-80a3-b91b5fc1c6fb' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:59 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:59 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_metadata_cache_azure_650f0bcb_5f84_4857_8223_8278519c86f8/data/a%3D0/00000-49-dbe77ec2-acb7-43af-bb56-0aaab223119e-00001.parquet' Request method: 'PUT' Request headers: 'Content-Length': '631' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '6cad7fe0-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:59 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_metadata_cache_azure_650f0bcb_5f84_4857_8223_8278519c86f8/data/a%3D0/00000-49-dbe77ec2-acb7-43af-bb56-0aaab223119e-00001.parquet HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:59 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x20DFA812B9452A0"' 'last-modified': 'Fri, 23 May 2025 21:10:59 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '6cad7fe0-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '64d25cee-467b-4ee7-9f93-1a239165dce5' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:59 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:59 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_metadata_cache_azure_650f0bcb_5f84_4857_8223_8278519c86f8/data/a%3D2/00000-49-dbe77ec2-acb7-43af-bb56-0aaab223119e-00003.parquet' Request method: 'PUT' Request headers: 'Content-Length': '631' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '6caeafc8-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:59 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_metadata_cache_azure_650f0bcb_5f84_4857_8223_8278519c86f8/data/a%3D2/00000-49-dbe77ec2-acb7-43af-bb56-0aaab223119e-00003.parquet HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:59 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x1EA3D0AFD6AD930"' 'last-modified': 'Fri, 23 May 2025 21:10:59 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '6caeafc8-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '343f7474-09ad-4a4a-9574-ac918d4899cc' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:59 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:59 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_metadata_cache_azure_650f0bcb_5f84_4857_8223_8278519c86f8/data/a%3D7/00000-49-dbe77ec2-acb7-43af-bb56-0aaab223119e-00008.parquet' Request method: 'PUT' Request headers: 'Content-Length': '631' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '6cb03848-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:59 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_metadata_cache_azure_650f0bcb_5f84_4857_8223_8278519c86f8/data/a%3D7/00000-49-dbe77ec2-acb7-43af-bb56-0aaab223119e-00008.parquet HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:59 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x26456A807F25240"' 'last-modified': 'Fri, 23 May 2025 21:10:59 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '6cb03848-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '6c0e3a8c-4249-4282-bca2-43dc50d5cee6' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:59 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:59 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_metadata_cache_azure_650f0bcb_5f84_4857_8223_8278519c86f8/data/a%3D9/00000-49-dbe77ec2-acb7-43af-bb56-0aaab223119e-00010.parquet' Request method: 'PUT' Request headers: 'Content-Length': '638' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '6cb1c668-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:59 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_metadata_cache_azure_650f0bcb_5f84_4857_8223_8278519c86f8/data/a%3D9/00000-49-dbe77ec2-acb7-43af-bb56-0aaab223119e-00010.parquet HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:59 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x1D64A83B9F4B850"' 'last-modified': 'Fri, 23 May 2025 21:10:59 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '6cb1c668-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '7752d8b7-69ac-4e20-9fc8-0b7fcfe6a7f1' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:59 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:59 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_metadata_cache_azure_650f0bcb_5f84_4857_8223_8278519c86f8/metadata/289b0b0c-fdcd-46cf-9112-d2005888e2bf-m0.avro' Request method: 'PUT' Request headers: 'Content-Length': '6162' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '6cb35136-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:59 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_metadata_cache_azure_650f0bcb_5f84_4857_8223_8278519c86f8/metadata/289b0b0c-fdcd-46cf-9112-d2005888e2bf-m0.avro HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:59 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x26474DCF4C89100"' 'last-modified': 'Fri, 23 May 2025 21:10:59 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '6cb35136-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': 'c605b86d-57ac-4284-bed7-81983c50be3a' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:59 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:59 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_metadata_cache_azure_650f0bcb_5f84_4857_8223_8278519c86f8/metadata/version-hint.text' Request method: 'PUT' Request headers: 'Content-Length': '1' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '6cb4b4c2-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:59 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_metadata_cache_azure_650f0bcb_5f84_4857_8223_8278519c86f8/metadata/version-hint.text HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:59 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x215482482153320"' 'last-modified': 'Fri, 23 May 2025 21:10:59 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '6cb4b4c2-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '010cac08-78cc-4d31-83cd-37954c97d290' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:59 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:59 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_metadata_cache_azure_650f0bcb_5f84_4857_8223_8278519c86f8/metadata/snap-4943979143139737116-1-289b0b0c-fdcd-46cf-9112-d2005888e2bf.avro' Request method: 'PUT' Request headers: 'Content-Length': '3803' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '6cb5df28-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:59 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_metadata_cache_azure_650f0bcb_5f84_4857_8223_8278519c86f8/metadata/snap-4943979143139737116-1-289b0b0c-fdcd-46cf-9112-d2005888e2bf.avro HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:59 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x1E6EF4119A924E0"' 'last-modified': 'Fri, 23 May 2025 21:10:59 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '6cb5df28-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': '6c5a75de-7059-471e-899a-e7719ce714ba' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:59 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:59 [ 671 ] INFO : Request URL: 'http://127.0.0.1:30050/devstoreaccount1/mycontainer//iceberg_data/default/test_metadata_cache_azure_650f0bcb_5f84_4857_8223_8278519c86f8/metadata/v1.metadata.json' Request method: 'PUT' Request headers: 'Content-Length': '2382' 'x-ms-blob-type': 'REDACTED' 'x-ms-version': 'REDACTED' 'Content-Type': 'application/octet-stream' 'Accept': 'application/xml' 'User-Agent': 'azsdk-python-storage-blob/12.19.0 Python/3.10.12 (Linux-5.15.0-130-generic-x86_64-with-glibc2.35)' 'x-ms-date': 'REDACTED' 'x-ms-client-request-id': '6cb7105a-381a-11f0-90ba-0242ac110002' 'Authorization': 'REDACTED' A body is sent with the request (_universal.py:511, on_request) 2025-05-23 21:10:59 [ 671 ] DEBUG : http://127.0.0.1:30050 "PUT /devstoreaccount1/mycontainer//iceberg_data/default/test_metadata_cache_azure_650f0bcb_5f84_4857_8223_8278519c86f8/metadata/v1.metadata.json HTTP/1.1" 201 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:59 [ 671 ] INFO : Response status: 201 Response headers: 'Server': 'Azurite-Blob/3.34.0' 'etag': '"0x2660251F727A2E0"' 'last-modified': 'Fri, 23 May 2025 21:10:59 GMT' 'content-md5': 'REDACTED' 'x-ms-client-request-id': '6cb7105a-381a-11f0-90ba-0242ac110002' 'x-ms-request-id': 'be8070c6-a6ee-42f6-8c76-c99119a145fc' 'x-ms-version': 'REDACTED' 'date': 'Fri, 23 May 2025 21:10:59 GMT' 'x-ms-request-server-encrypted': 'REDACTED' 'Connection': 'keep-alive' 'Keep-Alive': 'REDACTED' 'Content-Length': '0' (_universal.py:550, on_response) 2025-05-23 21:10:59 [ 671 ] DEBUG : Executing query SELECT * FROM icebergAzure(azure, container = 'mycontainer', storage_account_url = 'http://azurite1:30050/devstoreaccount1', blob_path = '/iceberg_data/default/test_metadata_cache_azure_650f0bcb_5f84_4857_8223_8278519c86f8/', format=Parquet) on node1 (cluster.py:3570, query) 2025-05-23 21:10:59 [ 671 ] DEBUG : Executing query SYSTEM FLUSH LOGS on node1 (cluster.py:3570, query) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: m d o1001 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: m d o1002 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: m d o1003 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: m d o998 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: m d o1000 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: m d o991 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: m d o1008 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: m d o1013 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: m d o1021 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: m d o1027 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: m d o1034 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: m d o1039 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: m d o1044 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: m d o1006 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: m d o1007 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: m d o1009 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: m d o1010 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: m d o1011 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: m d o1012 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: m d o1014 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: m d o1015 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: m d o1016 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: m d o1017 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: m d o1018 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: m d o1020 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: m d o1022 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: m d o1023 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: m d o1024 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: m d o1025 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: m d o1026 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: m d o1028 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: m d o1029 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: m d o1030 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: m d o1031 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: m d o1032 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: m d o1033 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: m d o1035 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: m d o1036 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: m d o1037 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: m d o1038 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: m d o1040 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: m d o1041 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: m d o1046 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: m d o1048 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: m d o1049 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Executing query SELECT ProfileEvents['IcebergMetadataFilesCacheMisses'] FROM system.query_log WHERE query_id = 'test_metadata_cache_azure_650f0bcb_5f84_4857_8223_8278519c86f8-243c9300-895f-4374-9d58-d62fe05bd046' AND type = 'QueryFinish' on node1 (cluster.py:3570, query) ___________________________ test_metadata_cache[s3] ____________________________ [gw1] linux -- Python 3.10.12 /usr/bin/python3 started_cluster = storage_type = 's3' @pytest.mark.parametrize("storage_type", ["s3", "azure"]) def test_metadata_cache(started_cluster, storage_type): instance = started_cluster.instances["node1"] spark = started_cluster.spark_session TABLE_NAME = "test_metadata_cache_" + storage_type + "_" + get_uuid_str() write_iceberg_from_df( spark, generate_data(spark, 0, 10), TABLE_NAME, mode="overwrite", format_version="1", partition_by="a", ) default_upload_directory( started_cluster, storage_type, f"/iceberg_data/default/{TABLE_NAME}/", f"/iceberg_data/default/{TABLE_NAME}/", ) table_expr = get_creation_expression(storage_type, TABLE_NAME, started_cluster, table_function=True) query_id = f"{TABLE_NAME}-{uuid.uuid4()}" instance.query( f"SELECT * FROM {table_expr}", query_id=query_id, ) instance.query("SYSTEM FLUSH LOGS") > assert 0 < int( instance.query( f"SELECT ProfileEvents['IcebergMetadataFilesCacheMisses'] FROM system.query_log WHERE query_id = '{query_id}' AND type = 'QueryFinish'" ) ) E assert 0 < 0 E + where 0 = int('0\n') E + where '0\n' = >("SELECT ProfileEvents['IcebergMetadataFilesCacheMisses'] FROM system.query_log WHERE query_id = 'test_metadata_cache_s3_a7fb5fa6_7fd4_41ce_b41f_173f479ae9d4-573ff413-25a0-4b7e-9a1b-d467c0a2ed73' AND type = 'QueryFinish'") E + where > = .query test_storage_iceberg/test.py:2695: AssertionError ----------------------------- Captured stdout call ----------------------------- 25/05/23 21:10:59 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:59 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:59 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:59 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:59 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/05/23 21:10:59 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. {} {} {} {} Upload to bucket: None {} Upload to bucket: None {} Upload to bucket: None {} Upload to bucket: None {} Upload to bucket: None {} Upload to bucket: None {} Upload to bucket: None {} Upload to bucket: None {} Upload to bucket: None {} Upload to bucket: None {} Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None ------------------------------ Captured log call ------------------------------- 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yro1050 (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: c o1050 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: c o61 range i0 i10 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yro1051 (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !ylo1052 (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: c o1052 add sa e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1052 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yro1053 (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: c o1051 toDF ro1053 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yro1054 (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: c o50 sc e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yro1055 (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: c o1055 defaultParallelism e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: c o61 range i1 i11 i1 i1 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yro1056 (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !ylo1057 (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: c o1057 add sb e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1057 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yro1058 (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: c o1056 toDF ro1058 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yro1059 (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: c o1059 apply sb e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yro1060 (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yro1061 (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: c o1061 isDefined e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yro1062 (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: c o1062 get e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yro1063 (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yro1064 (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yao1065 (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: c o1064 applyModifiableSettings ro1063 ro1065 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: c o61 parseDataType s"string" e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yro1066 (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: c o1060 cast ro1066 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yro1067 (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: c o1059 withColumn sb ro1067 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yro1068 (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yro1069 (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yro1070 (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !ylo1071 (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: c o1071 add ro1070 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1071 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yro1072 (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1072 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yro1073 (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: c o1069 over ro1073 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yro1074 (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: c o1054 withColumn srow_index ro1074 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yro1075 (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yro1076 (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yro1077 (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !ylo1078 (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: c o1078 add ro1077 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1078 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yro1079 (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1079 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yro1080 (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: c o1076 over ro1080 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yro1081 (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: c o1068 withColumn srow_index ro1081 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yro1082 (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !ylo1083 (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: c o1083 add srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1083 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yro1084 (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: c o1075 join ro1082 ro1084 sinner e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yro1085 (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: c o1085 drop srow_index e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yro1086 (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: c o1086 writeTo stest_metadata_cache_s3_a7fb5fa6_7fd4_41ce_b41f_173f479ae9d4 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yro1087 (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: c o1087 tableProperty sformat-version s1 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yro1088 (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: r m org.apache.spark.sql.functions col e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions col sa e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yro1089 (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !ylo1090 (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1090 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yro1091 (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: c o1087 partitionedBy ro1089 ro1091 e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yro1092 (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: c o1087 using siceberg e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yro1093 (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Command to send: c o1087 create e (clientserver.py:501, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:10:59 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_metadata_cache_s3_a7fb5fa6_7fd4_41ce_b41f_173f479ae9d4/data/a%3D4/00000-51-0eb31cf4-5a39-44c5-a471-c04c7c83a772-00005.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:59 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_metadata_cache_s3_a7fb5fa6_7fd4_41ce_b41f_173f479ae9d4/data/a%3D5/00000-51-0eb31cf4-5a39-44c5-a471-c04c7c83a772-00006.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:59 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_metadata_cache_s3_a7fb5fa6_7fd4_41ce_b41f_173f479ae9d4/data/a%3D6/00000-51-0eb31cf4-5a39-44c5-a471-c04c7c83a772-00007.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:10:59 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_metadata_cache_s3_a7fb5fa6_7fd4_41ce_b41f_173f479ae9d4/data/a%3D3/00000-51-0eb31cf4-5a39-44c5-a471-c04c7c83a772-00004.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:11:00 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_metadata_cache_s3_a7fb5fa6_7fd4_41ce_b41f_173f479ae9d4/data/a%3D1/00000-51-0eb31cf4-5a39-44c5-a471-c04c7c83a772-00002.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:11:00 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_metadata_cache_s3_a7fb5fa6_7fd4_41ce_b41f_173f479ae9d4/data/a%3D8/00000-51-0eb31cf4-5a39-44c5-a471-c04c7c83a772-00009.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:11:00 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_metadata_cache_s3_a7fb5fa6_7fd4_41ce_b41f_173f479ae9d4/data/a%3D0/00000-51-0eb31cf4-5a39-44c5-a471-c04c7c83a772-00001.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:11:00 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_metadata_cache_s3_a7fb5fa6_7fd4_41ce_b41f_173f479ae9d4/data/a%3D2/00000-51-0eb31cf4-5a39-44c5-a471-c04c7c83a772-00003.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:11:00 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_metadata_cache_s3_a7fb5fa6_7fd4_41ce_b41f_173f479ae9d4/data/a%3D7/00000-51-0eb31cf4-5a39-44c5-a471-c04c7c83a772-00008.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:11:00 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_metadata_cache_s3_a7fb5fa6_7fd4_41ce_b41f_173f479ae9d4/data/a%3D9/00000-51-0eb31cf4-5a39-44c5-a471-c04c7c83a772-00010.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:11:00 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_metadata_cache_s3_a7fb5fa6_7fd4_41ce_b41f_173f479ae9d4/metadata/version-hint.text HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:11:00 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_metadata_cache_s3_a7fb5fa6_7fd4_41ce_b41f_173f479ae9d4/metadata/v1.metadata.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:11:00 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_metadata_cache_s3_a7fb5fa6_7fd4_41ce_b41f_173f479ae9d4/metadata/snap-1018271958903317091-1-ce9320cb-36cb-4aaf-90f8-e3b344e9d83c.avro HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:11:00 [ 671 ] DEBUG : http://172.16.1.4:9001 "PUT /root//iceberg_data/default/test_metadata_cache_s3_a7fb5fa6_7fd4_41ce_b41f_173f479ae9d4/metadata/ce9320cb-36cb-4aaf-90f8-e3b344e9d83c-m0.avro HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-05-23 21:11:00 [ 671 ] DEBUG : Executing query SELECT * FROM icebergS3(s3, filename = 'iceberg_data/default/test_metadata_cache_s3_a7fb5fa6_7fd4_41ce_b41f_173f479ae9d4/', format=Parquet, url = 'http://minio1:9001/root/') on node1 (cluster.py:3570, query) 2025-05-23 21:11:00 [ 671 ] DEBUG : Executing query SYSTEM FLUSH LOGS on node1 (cluster.py:3570, query) 2025-05-23 21:11:00 [ 671 ] DEBUG : Executing query SELECT ProfileEvents['IcebergMetadataFilesCacheMisses'] FROM system.query_log WHERE query_id = 'test_metadata_cache_s3_a7fb5fa6_7fd4_41ce_b41f_173f479ae9d4-573ff413-25a0-4b7e-9a1b-d467c0a2ed73' AND type = 'QueryFinish' on node1 (cluster.py:3570, query) ---------------------------- Captured log teardown ----------------------------- 2025-05-23 21:11:00 [ 671 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/.env --project-name rootteststorageiceberg-gw1 --file /ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml --file /ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/node3/docker-compose.yml stop --timeout 20] (cluster.py:121, run_and_check) 2025-05-23 21:11:00 [ 671 ] DEBUG : Command to send: m d o1045 e (clientserver.py:501, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Command to send: m d o1047 e (clientserver.py:501, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Command to send: m d o1043 e (clientserver.py:501, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Command to send: m d o1042 e (clientserver.py:501, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Command to send: m d o1052 e (clientserver.py:501, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Command to send: m d o1057 e (clientserver.py:501, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Command to send: m d o1065 e (clientserver.py:501, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Command to send: m d o1071 e (clientserver.py:501, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Command to send: m d o1078 e (clientserver.py:501, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Command to send: m d o1083 e (clientserver.py:501, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Command to send: m d o1088 e (clientserver.py:501, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Command to send: m d o1050 e (clientserver.py:501, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Command to send: m d o1051 e (clientserver.py:501, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Command to send: m d o1053 e (clientserver.py:501, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Command to send: m d o1054 e (clientserver.py:501, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Command to send: m d o1055 e (clientserver.py:501, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Command to send: m d o1056 e (clientserver.py:501, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Command to send: m d o1058 e (clientserver.py:501, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Command to send: m d o1059 e (clientserver.py:501, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Command to send: m d o1060 e (clientserver.py:501, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Command to send: m d o1061 e (clientserver.py:501, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Command to send: m d o1062 e (clientserver.py:501, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Command to send: m d o1064 e (clientserver.py:501, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Command to send: m d o1066 e (clientserver.py:501, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Command to send: m d o1067 e (clientserver.py:501, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Command to send: m d o1068 e (clientserver.py:501, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Command to send: m d o1069 e (clientserver.py:501, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Command to send: m d o1070 e (clientserver.py:501, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Command to send: m d o1072 e (clientserver.py:501, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Command to send: m d o1073 e (clientserver.py:501, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Command to send: m d o1074 e (clientserver.py:501, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Command to send: m d o1075 e (clientserver.py:501, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Command to send: m d o1076 e (clientserver.py:501, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Command to send: m d o1077 e (clientserver.py:501, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Command to send: m d o1079 e (clientserver.py:501, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Command to send: m d o1080 e (clientserver.py:501, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Command to send: m d o1081 e (clientserver.py:501, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Command to send: m d o1082 e (clientserver.py:501, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Command to send: m d o1084 e (clientserver.py:501, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Command to send: m d o1085 e (clientserver.py:501, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Command to send: m d o1090 e (clientserver.py:501, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Command to send: m d o1092 e (clientserver.py:501, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Command to send: m d o1093 e (clientserver.py:501, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Command to send: m d o1089 e (clientserver.py:501, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Command to send: m d o1091 e (clientserver.py:501, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Command to send: m d o1087 e (clientserver.py:501, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Command to send: m d o1086 e (clientserver.py:501, send_command) 2025-05-23 21:11:00 [ 671 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-05-23 21:11:20 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-node3-1 Stopping (cluster.py:147, run_and_check) 2025-05-23 21:11:20 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-node1-1 Stopping (cluster.py:147, run_and_check) 2025-05-23 21:11:20 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-resolver-1 Stopping (cluster.py:147, run_and_check) 2025-05-23 21:11:20 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-node2-1 Stopping (cluster.py:147, run_and_check) 2025-05-23 21:11:20 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-node3-1 Stopped (cluster.py:147, run_and_check) 2025-05-23 21:11:20 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-node1-1 Stopped (cluster.py:147, run_and_check) 2025-05-23 21:11:20 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-minio1-1 Stopping (cluster.py:147, run_and_check) 2025-05-23 21:11:20 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-azurite1-1 Stopping (cluster.py:147, run_and_check) 2025-05-23 21:11:20 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-node2-1 Stopped (cluster.py:147, run_and_check) 2025-05-23 21:11:20 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-minio1-1 Stopped (cluster.py:147, run_and_check) 2025-05-23 21:11:20 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-azurite1-1 Stopped (cluster.py:147, run_and_check) 2025-05-23 21:11:20 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-resolver-1 Stopped (cluster.py:147, run_and_check) 2025-05-23 21:11:20 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-proxy1-1 Stopping (cluster.py:147, run_and_check) 2025-05-23 21:11:20 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-proxy2-1 Stopping (cluster.py:147, run_and_check) 2025-05-23 21:11:20 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-proxy2-1 Stopped (cluster.py:147, run_and_check) 2025-05-23 21:11:20 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-proxy1-1 Stopped (cluster.py:147, run_and_check) 2025-05-23 21:11:20 [ 671 ] DEBUG : Command:[bash -c [ -f /ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] (cluster.py:121, run_and_check) 2025-05-23 21:11:20 [ 671 ] DEBUG : Command:[bash -c [ -f /ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/node2/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/node2/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] (cluster.py:121, run_and_check) 2025-05-23 21:11:20 [ 671 ] DEBUG : Command:[bash -c [ -f /ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/node3/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/node3/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] (cluster.py:121, run_and_check) 2025-05-23 21:11:20 [ 671 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/.env --project-name rootteststorageiceberg-gw1 --file /ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_azurite.yml --file /ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_storage_iceberg/_instances-1-gw1/node3/docker-compose.yml down --volumes] (cluster.py:121, run_and_check) 2025-05-23 21:11:21 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-node2-1 Stopping (cluster.py:147, run_and_check) 2025-05-23 21:11:21 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-node3-1 Stopping (cluster.py:147, run_and_check) 2025-05-23 21:11:21 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-resolver-1 Stopping (cluster.py:147, run_and_check) 2025-05-23 21:11:21 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-node1-1 Stopping (cluster.py:147, run_and_check) 2025-05-23 21:11:21 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-node2-1 Stopped (cluster.py:147, run_and_check) 2025-05-23 21:11:21 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-node2-1 Removing (cluster.py:147, run_and_check) 2025-05-23 21:11:21 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-resolver-1 Stopped (cluster.py:147, run_and_check) 2025-05-23 21:11:21 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-resolver-1 Removing (cluster.py:147, run_and_check) 2025-05-23 21:11:21 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-node3-1 Stopped (cluster.py:147, run_and_check) 2025-05-23 21:11:21 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-node3-1 Removing (cluster.py:147, run_and_check) 2025-05-23 21:11:21 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-node1-1 Stopped (cluster.py:147, run_and_check) 2025-05-23 21:11:21 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-node1-1 Removing (cluster.py:147, run_and_check) 2025-05-23 21:11:21 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-resolver-1 Removed (cluster.py:147, run_and_check) 2025-05-23 21:11:21 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-node3-1 Removed (cluster.py:147, run_and_check) 2025-05-23 21:11:21 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-node1-1 Removed (cluster.py:147, run_and_check) 2025-05-23 21:11:21 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-azurite1-1 Stopping (cluster.py:147, run_and_check) 2025-05-23 21:11:21 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-minio1-1 Stopping (cluster.py:147, run_and_check) 2025-05-23 21:11:21 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-node2-1 Removed (cluster.py:147, run_and_check) 2025-05-23 21:11:21 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-azurite1-1 Stopped (cluster.py:147, run_and_check) 2025-05-23 21:11:21 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-azurite1-1 Removing (cluster.py:147, run_and_check) 2025-05-23 21:11:21 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-minio1-1 Stopped (cluster.py:147, run_and_check) 2025-05-23 21:11:21 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-minio1-1 Removing (cluster.py:147, run_and_check) 2025-05-23 21:11:21 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-azurite1-1 Removed (cluster.py:147, run_and_check) 2025-05-23 21:11:21 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-minio1-1 Removed (cluster.py:147, run_and_check) 2025-05-23 21:11:21 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-proxy2-1 Stopping (cluster.py:147, run_and_check) 2025-05-23 21:11:21 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-proxy1-1 Stopping (cluster.py:147, run_and_check) 2025-05-23 21:11:21 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-proxy2-1 Stopped (cluster.py:147, run_and_check) 2025-05-23 21:11:21 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-proxy2-1 Removing (cluster.py:147, run_and_check) 2025-05-23 21:11:21 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-proxy1-1 Stopped (cluster.py:147, run_and_check) 2025-05-23 21:11:21 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-proxy1-1 Removing (cluster.py:147, run_and_check) 2025-05-23 21:11:21 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-proxy2-1 Removed (cluster.py:147, run_and_check) 2025-05-23 21:11:21 [ 671 ] DEBUG : Stderr: Container rootteststorageiceberg-gw1-proxy1-1 Removed (cluster.py:147, run_and_check) 2025-05-23 21:11:21 [ 671 ] DEBUG : Stderr: Volume rootteststorageiceberg-gw1_data1-1 Removing (cluster.py:147, run_and_check) 2025-05-23 21:11:21 [ 671 ] DEBUG : Stderr: Network rootteststorageiceberg-gw1_default Removing (cluster.py:147, run_and_check) 2025-05-23 21:11:21 [ 671 ] DEBUG : Stderr: Volume rootteststorageiceberg-gw1_data1-1 Removed (cluster.py:147, run_and_check) 2025-05-23 21:11:21 [ 671 ] DEBUG : Stderr: Network rootteststorageiceberg-gw1_default Removed (cluster.py:147, run_and_check) 2025-05-23 21:11:21 [ 671 ] DEBUG : Cleanup called (cluster.py:846, cleanup) 2025-05-23 21:11:21 [ 671 ] DEBUG : Docker networks for project rootteststorageiceberg-gw1 are NETWORK ID NAME DRIVER SCOPE (cluster.py:825, print_all_docker_pieces) 2025-05-23 21:11:21 [ 671 ] DEBUG : Docker containers for project rootteststorageiceberg-gw1 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:833, print_all_docker_pieces) 2025-05-23 21:11:21 [ 671 ] DEBUG : Docker volumes for project rootteststorageiceberg-gw1 are DRIVER VOLUME NAME (cluster.py:841, print_all_docker_pieces) 2025-05-23 21:11:21 [ 671 ] DEBUG : Command:[docker container list --all --filter name='^/rootteststorageiceberg-gw1-.*-1$' --format '{{.ID}}:{{.Names}}'] (cluster.py:121, run_and_check) 2025-05-23 21:11:21 [ 671 ] DEBUG : Unstopped containers: {} (cluster.py:860, cleanup) 2025-05-23 21:11:21 [ 671 ] DEBUG : No running containers for project: rootteststorageiceberg-gw1 (cluster.py:874, cleanup) 2025-05-23 21:11:21 [ 671 ] DEBUG : Trying to prune unused networks... (cluster.py:880, cleanup) 2025-05-23 21:11:21 [ 671 ] DEBUG : Trying to prune unused images... (cluster.py:896, cleanup) 2025-05-23 21:11:21 [ 671 ] DEBUG : Command:[docker image prune -f] (cluster.py:121, run_and_check) 2025-05-23 21:11:21 [ 671 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:145, run_and_check) 2025-05-23 21:11:21 [ 671 ] DEBUG : Images pruned (cluster.py:899, cleanup) 2025-05-23 21:11:21 [ 671 ] DEBUG : Trying to prune unused volumes... (cluster.py:905, cleanup) 2025-05-23 21:11:21 [ 671 ] DEBUG : Command:[docker volume ls | wc -l] (cluster.py:121, run_and_check) 2025-05-23 21:11:21 [ 671 ] DEBUG : Stdout:1 (cluster.py:145, run_and_check) 2025-05-23 21:11:21 [ 671 ] DEBUG : Volumes pruned: 1 (cluster.py:910, cleanup) ----------------- generated report log file: parallel2_1.jsonl ----------------- ============================== slowest durations =============================== 69.30s setup test_storage_iceberg/test.py::test_cluster_table_function[azure-1] 21.20s teardown test_storage_iceberg/test.py::test_metadata_cache[s3] 7.56s call test_storage_iceberg/test.py::test_cluster_table_function[azure-1] 1.69s call test_storage_iceberg/test.py::test_cluster_table_function[azure-2] 1.38s call test_storage_iceberg/test.py::test_cluster_table_function[s3-1] 1.31s call test_storage_iceberg/test.py::test_cluster_table_function[s3-2] 1.10s call test_storage_iceberg/test.py::test_delete_files[local-2] 1.01s call test_storage_iceberg/test.py::test_delete_files[local-1] 0.89s call test_storage_iceberg/test.py::test_metadata_cache[azure] 0.86s call test_storage_iceberg/test.py::test_iceberg_snapshot_reads[local-1] 0.85s call test_storage_iceberg/test.py::test_delete_files[azure-1] 0.85s call test_storage_iceberg/test.py::test_iceberg_snapshot_reads[local-2] 0.80s call test_storage_iceberg/test.py::test_delete_files[azure-2] 0.73s call test_storage_iceberg/test.py::test_delete_files[s3-1] 0.66s call test_storage_iceberg/test.py::test_delete_files[s3-2] 0.63s call test_storage_iceberg/test.py::test_iceberg_snapshot_reads[azure-1] 0.62s call test_storage_iceberg/test.py::test_metadata_cache[s3] 0.53s call test_storage_iceberg/test.py::test_iceberg_snapshot_reads[azure-2] 0.43s call test_storage_iceberg/test.py::test_iceberg_snapshot_reads[s3-1] 0.42s call test_storage_iceberg/test.py::test_iceberg_snapshot_reads[s3-2] 0.00s teardown test_storage_iceberg/test.py::test_cluster_table_function[azure-2] 0.00s teardown test_storage_iceberg/test.py::test_cluster_table_function[azure-1] 0.00s setup test_storage_iceberg/test.py::test_cluster_table_function[s3-1] 0.00s teardown test_storage_iceberg/test.py::test_cluster_table_function[s3-2] 0.00s teardown test_storage_iceberg/test.py::test_delete_files[azure-1] 0.00s teardown test_storage_iceberg/test.py::test_cluster_table_function[s3-1] 0.00s setup test_storage_iceberg/test.py::test_cluster_table_function[azure-2] 0.00s teardown test_storage_iceberg/test.py::test_delete_files[azure-2] 0.00s teardown test_storage_iceberg/test.py::test_delete_files[s3-1] 0.00s setup test_storage_iceberg/test.py::test_delete_files[azure-2] 0.00s teardown test_storage_iceberg/test.py::test_iceberg_snapshot_reads[azure-2] 0.00s teardown test_storage_iceberg/test.py::test_metadata_cache[azure] 0.00s teardown test_storage_iceberg/test.py::test_iceberg_snapshot_reads[local-1] 0.00s setup test_storage_iceberg/test.py::test_delete_files[local-1] 0.00s teardown test_storage_iceberg/test.py::test_iceberg_snapshot_reads[s3-2] 0.00s setup test_storage_iceberg/test.py::test_delete_files[s3-2] 0.00s teardown test_storage_iceberg/test.py::test_iceberg_snapshot_reads[s3-1] 0.00s teardown test_storage_iceberg/test.py::test_delete_files[local-2] 0.00s teardown test_storage_iceberg/test.py::test_delete_files[local-1] 0.00s teardown test_storage_iceberg/test.py::test_iceberg_snapshot_reads[azure-1] 0.00s teardown test_storage_iceberg/test.py::test_delete_files[s3-2] 0.00s teardown test_storage_iceberg/test.py::test_iceberg_snapshot_reads[local-2] 0.00s setup test_storage_iceberg/test.py::test_cluster_table_function[s3-2] 0.00s setup test_storage_iceberg/test.py::test_iceberg_snapshot_reads[local-2] 0.00s setup test_storage_iceberg/test.py::test_iceberg_snapshot_reads[azure-1] 0.00s setup test_storage_iceberg/test.py::test_iceberg_snapshot_reads[azure-2] 0.00s setup test_storage_iceberg/test.py::test_delete_files[s3-1] 0.00s setup test_storage_iceberg/test.py::test_iceberg_snapshot_reads[local-1] 0.00s setup test_storage_iceberg/test.py::test_delete_files[azure-1] 0.00s setup test_storage_iceberg/test.py::test_metadata_cache[s3] 0.00s setup test_storage_iceberg/test.py::test_iceberg_snapshot_reads[s3-2] 0.00s setup test_storage_iceberg/test.py::test_delete_files[local-2] 0.00s setup test_storage_iceberg/test.py::test_iceberg_snapshot_reads[s3-1] 0.00s setup test_storage_iceberg/test.py::test_metadata_cache[azure] =========================== short test summary info ============================ FAILED test_storage_iceberg/test.py::test_cluster_table_function[azure-1] - h... FAILED test_storage_iceberg/test.py::test_cluster_table_function[azure-2] - h... FAILED test_storage_iceberg/test.py::test_cluster_table_function[s3-1] - help... FAILED test_storage_iceberg/test.py::test_cluster_table_function[s3-2] - help... FAILED test_storage_iceberg/test.py::test_delete_files[azure-1] - AssertionEr... FAILED test_storage_iceberg/test.py::test_delete_files[azure-2] - AssertionEr... FAILED test_storage_iceberg/test.py::test_delete_files[local-1] - AssertionEr... FAILED test_storage_iceberg/test.py::test_delete_files[local-2] - AssertionEr... FAILED test_storage_iceberg/test.py::test_delete_files[s3-1] - AssertionError... FAILED test_storage_iceberg/test.py::test_delete_files[s3-2] - AssertionError... FAILED test_storage_iceberg/test.py::test_iceberg_snapshot_reads[azure-1] - N... FAILED test_storage_iceberg/test.py::test_iceberg_snapshot_reads[azure-2] - N... FAILED test_storage_iceberg/test.py::test_iceberg_snapshot_reads[local-1] - N... FAILED test_storage_iceberg/test.py::test_iceberg_snapshot_reads[local-2] - N... FAILED test_storage_iceberg/test.py::test_iceberg_snapshot_reads[s3-1] - Name... FAILED test_storage_iceberg/test.py::test_iceberg_snapshot_reads[s3-2] - Name... FAILED test_storage_iceberg/test.py::test_metadata_cache[azure] - assert 0 < 0 FAILED test_storage_iceberg/test.py::test_metadata_cache[s3] - assert 0 < 0 ======================== 18 failed in 116.33s (0:01:56) ======================== Traceback (most recent call last): File "/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration/./runner", line 492, in subprocess.check_call(cmd, shell=True, bufsize=0) File "/usr/lib/python3.10/subprocess.py", line 369, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command 'docker run --rm --name clickhouse_integration_tests_dnzqhs --privileged --dns-search='.' --memory=30709035008 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=5dc43a6382f0 -e DOCKER_BASE_TAG=5ccda723c1fc -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=d862517635bf -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=1 --color=no --durations=0 --report-log=parallel2_1.jsonl --report-log-exclude-logs-on-passed-tests 'test_storage_iceberg/test.py::test_cluster_table_function[azure-1]' 'test_storage_iceberg/test.py::test_cluster_table_function[azure-2]' 'test_storage_iceberg/test.py::test_cluster_table_function[s3-1]' 'test_storage_iceberg/test.py::test_cluster_table_function[s3-2]' 'test_storage_iceberg/test.py::test_delete_files[azure-1]' 'test_storage_iceberg/test.py::test_delete_files[azure-2]' 'test_storage_iceberg/test.py::test_delete_files[local-1]' 'test_storage_iceberg/test.py::test_delete_files[local-2]' 'test_storage_iceberg/test.py::test_delete_files[s3-1]' 'test_storage_iceberg/test.py::test_delete_files[s3-2]' 'test_storage_iceberg/test.py::test_iceberg_snapshot_reads[azure-1]' 'test_storage_iceberg/test.py::test_iceberg_snapshot_reads[azure-2]' 'test_storage_iceberg/test.py::test_iceberg_snapshot_reads[local-1]' 'test_storage_iceberg/test.py::test_iceberg_snapshot_reads[local-2]' 'test_storage_iceberg/test.py::test_iceberg_snapshot_reads[s3-1]' 'test_storage_iceberg/test.py::test_iceberg_snapshot_reads[s3-2]' 'test_storage_iceberg/test.py::test_metadata_cache[azure]' 'test_storage_iceberg/test.py::test_metadata_cache[s3]' -vvv " altinityinfra/integration-tests-runner:ad96270260ff ' returned non-zero exit status 1.